-- Logs begin at Thu 2022-08-25 01:52:14 UTC, end at Thu 2022-08-25 03:46:58 UTC. -- Aug 25 03:10:19.517363 dv-cinder-851640-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 03:10:19.526585 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 03:10:19 2022] *** Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: nodename: dv-cinder-851640-5-iscsi Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: machine: x86_64 Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: clock source: unix Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: pcre jit disabled Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: detected number of CPU cores: 4 Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: current working directory: / Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: detected binary path: /usr/bin/uwsgi-core Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: your processes number limit is 47680 Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: your memory page size is 4096 bytes Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: detected max file descriptor number: 2048 Aug 25 03:10:19.528532 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: lock engine: pthread robust mutexes Aug 25 03:10:19.529383 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: thunder lock: enabled Aug 25 03:10:19.529383 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 03:10:19.529383 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 03:10:19.567352 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: Python main interpreter initialized at 0x55ac3edcf9c0 Aug 25 03:10:19.567352 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: python threads support enabled Aug 25 03:10:19.567352 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: your server socket listen backlog is limited to 100 connections Aug 25 03:10:19.567352 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: your mercy for graceful operations on workers is 90 seconds Aug 25 03:10:19.567687 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 03:10:19.567764 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: *** Operational MODE: preforking *** Aug 25 03:10:19.568008 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: *** uWSGI is running in multiple interpreter mode *** Aug 25 03:10:19.568008 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: spawned uWSGI master process (pid: 106244) Aug 25 03:10:19.568194 dv-cinder-851640-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 03:10:19.569250 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: spawned uWSGI worker 1 (pid: 106245, cores: 1) Aug 25 03:10:19.569250 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: spawned uWSGI worker 2 (pid: 106246, cores: 1) Aug 25 03:10:19.569250 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 03:10:20.227135 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 03:10:20.227743 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 03:10:21.315948 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:10:21.315948 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: from cryptography.utils import int_from_bytes Aug 25 03:10:21.316541 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:10:21.316541 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: from cryptography.utils import int_from_bytes Aug 25 03:10:21.318444 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:10:21.318444 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: from cryptography.utils import int_from_bytes Aug 25 03:10:21.318887 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:10:21.318887 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: from cryptography.utils import int_from_bytes Aug 25 03:10:23.810186 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 03:10:23.810873 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 03:10:23.810962 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 03:10:23.811286 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 03:10:23.811355 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 03:10:23.811431 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 03:10:23.811531 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 03:10:23.811602 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 03:10:23.811857 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 03:10:23.811958 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.812114 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 03:10:23.812240 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.812504 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.812597 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.812837 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.812932 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.813160 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.813248 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.813471 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.813573 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.813788 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.813887 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.814096 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.814187 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.814446 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.829846 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.829846 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830036 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830110 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830184 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830248 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-5-iscsi {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830343 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830425 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830498 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830575 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830640 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-5-iscsi {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830703 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830765 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830837 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830901 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.830969 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831034 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831096 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831158 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831230 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831301 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831301 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831426 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831545 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831663 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831761 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831837 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831908 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.831984 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832057 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832122 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832199 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832269 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832334 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832402 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832514 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832586 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832660 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832724 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832792 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832856 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.832933 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833004 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833069 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833131 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-5-iscsi {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833273 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833349 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833413 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-5-iscsi {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833476 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833550 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833614 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833677 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833738 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833800 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833881 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.833955 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834020 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834082 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834152 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834222 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834525 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834602 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834666 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834741 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.834816 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.835516 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.835658 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.835741 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.835828 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.835913 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836005 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836005 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836176 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836263 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836350 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836438 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836523 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836604 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836692 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836776 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836854 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.836939 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837024 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837108 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837201 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837280 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837357 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837442 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837520 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837597 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837679 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837757 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837844 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.837923 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838000 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838076 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838168 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838266 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838533 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838616 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838693 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838771 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838849 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.838939 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839019 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839097 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839174 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839250 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839335 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839425 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839505 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839582 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839658 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839742 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839821 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839906 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.839984 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840061 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840137 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840220 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840306 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840391 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840469 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840551 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840629 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840706 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840790 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840790 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840931 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.840931 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841077 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841224 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841320 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841399 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841505 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841595 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841674 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841804 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.841941 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842025 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842113 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842192 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842269 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842424 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842507 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842585 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842661 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842747 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842832 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.842919 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843049 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843138 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843216 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843299 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843377 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843465 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843550 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843633 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843722 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843799 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843876 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.843962 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844049 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844127 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844204 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844280 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844356 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844444 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844523 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844665 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844747 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844824 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844909 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.844988 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845065 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845141 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845217 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845299 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845386 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845464 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845561 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845691 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845782 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.845907 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846000 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846081 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846158 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846241 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846363 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846443 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846539 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846631 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846709 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846793 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846871 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.846956 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847041 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847127 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847206 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847340 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847424 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847508 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847599 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847685 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847837 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.847918 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848002 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848079 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848165 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848243 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848320 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848404 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848504 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848693 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848791 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848872 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.848949 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849025 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849102 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849187 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849267 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849344 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849553 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849642 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849876 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.849972 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.850180 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.850267 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.850534 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.850632 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.850842 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.850939 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.851161 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.851249 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.851464 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.851549 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.851767 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.851862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.852070 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.852172 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.852370 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.852462 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.852669 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.852756 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.852970 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.853060 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.853278 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.853374 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.853581 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.853676 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.853886 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.853979 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.854191 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.854302 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.854537 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.854625 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.854844 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.854939 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.855154 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.855242 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.855479 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:10:23.855567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.855816 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.855902 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.856147 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.856242 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.856480 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.856566 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.856797 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.856882 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.857106 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.857203 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.857420 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.857513 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.857749 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.857834 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.858061 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.858155 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.858397 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.858487 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.858717 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.858853 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.859030 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.859124 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.859347 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.859439 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.859664 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.859754 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.859986 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.860087 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.860303 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.860398 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.860623 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.860720 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.860935 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.861035 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.861253 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.861365 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.861576 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.861666 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.861893 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.861983 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.862206 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.862332 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.862572 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.862674 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.862918 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.863019 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.863234 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.863339 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.863561 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.863656 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.863883 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.863971 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.864195 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.864282 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.864507 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.864593 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.864818 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.864912 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.865130 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.865216 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.865444 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.865545 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.865758 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.865852 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.866075 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.866161 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.866460 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.866574 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.866781 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.867077 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.867171 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.867408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.867635 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.867990 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.868312 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.868646 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.868743 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.868944 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.869042 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.869287 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.869387 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.869608 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.869704 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.869921 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.870089 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.870238 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.870366 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.870590 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.870678 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.870907 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.871010 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.871219 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.871307 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.871533 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.871621 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.871845 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.871945 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.872149 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.872252 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.872457 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.872557 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.872759 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.872858 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.873069 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.873157 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.873371 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.873471 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.873673 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.873776 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.873981 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.874072 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.874321 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.874437 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.874622 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.874714 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.874943 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.875042 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.875256 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.875345 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.875563 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.875652 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.875872 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.875967 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.876178 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.876275 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.876491 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.876582 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.876800 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.876886 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.877102 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.877184 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.877410 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.877516 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.877720 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.877808 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.878025 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.878124 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.878370 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.878463 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.878678 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.878767 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.878984 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.879092 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.879300 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.879387 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.879609 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.879697 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.879922 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.880019 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.880231 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.880319 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.880540 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.880627 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.880850 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.880946 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.881162 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.881249 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.881474 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.881562 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.882353 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.882465 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.882717 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.882837 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.883026 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.883145 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.883352 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.883459 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.883681 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.883794 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.884043 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.884139 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.884305 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.884424 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.884616 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.884755 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.884926 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.885085 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.885232 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.885408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.885536 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.885717 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.885846 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.886032 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.886154 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.886377 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.886481 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.886690 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.886979 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.887081 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.887294 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.887383 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.887600 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.887694 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.887909 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.888011 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.888215 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.888311 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.888523 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.888769 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.888905 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.889149 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.889246 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.889482 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.889570 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.889792 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.889889 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.890132 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.890224 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.890546 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.890648 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.890887 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.890984 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.891199 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.891286 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.891522 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.891609 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.891840 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.891941 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.892160 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.892256 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.892473 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.892561 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.892789 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.892889 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.893103 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.893193 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.893417 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.893505 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.893736 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.893835 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.894047 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.894136 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.894388 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.894493 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.894701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.894790 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.895022 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.895116 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.895334 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.895422 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.895653 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.895748 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.895956 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.896044 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.896273 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.896368 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.896598 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.896694 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.896910 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.896998 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.897231 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.897327 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.898119 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.898219 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.898459 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.898562 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.898779 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.898882 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.899094 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.899189 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.899408 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.899502 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.899721 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.899821 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.900036 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.900125 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.900351 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.900439 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.900661 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.900828 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.900978 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.901065 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.901286 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.901374 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.901606 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.901703 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.901914 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.902002 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.902233 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.902356 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.902564 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.902654 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.902967 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.903201 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.903288 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.903513 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.903602 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.903827 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.903925 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.904142 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.904230 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.904464 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.904554 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.904775 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.904865 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.905087 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.905183 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.905399 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.905498 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.905707 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.905805 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.906014 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.906113 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.906348 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.906455 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.906661 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.906757 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.906967 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.907064 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.907277 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.907365 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.907581 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.907671 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.907894 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.907990 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.908198 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.908286 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.908504 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.908598 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.908805 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.908906 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.909116 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.909259 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.909438 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.909536 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.909726 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.909817 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.910045 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.910133 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.910396 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.910487 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.910704 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.910794 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.911010 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.911099 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.911334 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.911421 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.911639 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.911727 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.911941 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.912028 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.912246 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.912341 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.912549 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.912638 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.912858 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.912998 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.913192 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.913281 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.913501 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.913591 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.913812 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.913906 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.914133 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.914230 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.914465 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.914566 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.914786 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.914875 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.915115 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.915219 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.915407 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.915502 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.915727 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.915825 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.916040 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.916137 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.916351 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.916439 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.916661 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.916748 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.916974 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.917072 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.917284 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.917373 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.917594 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.917680 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.917907 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.917995 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.918214 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.918322 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.918554 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.918642 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.918865 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.918954 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.919171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.919259 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.919485 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.919582 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.919796 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.919884 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.920105 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.920376 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.920471 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.920712 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.920810 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.921031 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.921280 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.921368 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.921619 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.921723 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.921941 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.922030 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.922263 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.922449 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.922607 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.922697 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.922945 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.923071 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.923253 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.923354 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.923563 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.923654 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.923869 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.923958 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.924174 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.924263 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.924485 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.924572 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.924789 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.924949 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.925093 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.925187 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.925400 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.925499 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.925706 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.925803 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.926007 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.926095 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.926330 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.926423 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.926638 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.926738 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.926944 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.927033 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.927258 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.927346 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.927562 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.927662 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.927870 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.927958 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.928173 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.928260 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.928477 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.928567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.929302 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.929428 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.929611 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.929707 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.929914 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.930022 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.930220 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.930325 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.930557 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.930645 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.930866 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.930957 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.931174 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.931270 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.931522 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.931624 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.931832 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.931921 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.932163 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.932259 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.932470 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.932628 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.932796 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.932886 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.933103 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.933199 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.933408 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.933506 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.933716 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.933804 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.934026 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.934120 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.934364 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.934472 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.934669 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.934764 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.934978 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.935065 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.935289 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.935378 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.935593 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.935680 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.935898 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.935985 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.936204 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.936302 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.936512 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.936600 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.936814 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.936902 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.937118 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.937206 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.937424 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.937519 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.937727 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.937814 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.938026 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.938116 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.938361 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.938454 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.938672 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.938773 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.938974 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.939065 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.939285 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.939381 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.939590 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.939699 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.939893 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.939996 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.940194 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.940282 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.940500 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.940596 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.940809 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.940909 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.941117 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.941253 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.941422 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.941524 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.941725 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.941814 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.942036 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.942131 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.942370 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.942461 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.942677 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.942765 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.942979 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.943068 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.943288 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.943377 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.943593 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.943689 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.943896 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.943992 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.944335 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.945047 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.945137 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.945359 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.945460 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.945662 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.945752 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.945975 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.946064 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.946568 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.946679 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.946877 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.946974 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.947181 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.947279 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.947488 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.947583 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.947790 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.947878 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.948092 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.948185 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.948392 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.948492 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.948692 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.948781 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.948995 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.949082 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.949308 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.949404 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.949613 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.949712 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.949919 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.950014 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.950221 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.950355 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.950551 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.950639 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.950860 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.950949 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.951169 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.951259 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.951477 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.951572 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.951853 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.951949 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.952158 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.952260 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.952474 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.952561 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.952786 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.952879 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.953100 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.953190 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.953412 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.953500 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.953716 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.953804 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.954028 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.954116 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.954361 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.954456 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.954671 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.954841 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.954974 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.955062 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.955276 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.955371 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.955592 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.955693 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.955899 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.955989 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.956207 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.956296 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.956529 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.956625 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.956843 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.956929 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.957160 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.957248 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.957462 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.957565 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.957772 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.957861 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.958084 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.958171 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.958419 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.958513 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.958731 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.958818 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.959041 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.959128 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.959356 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.959446 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.959668 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.959763 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.960005 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.960093 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.960317 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.960407 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.960633 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.960719 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.960938 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.961024 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.961247 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.961419 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.961555 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.961652 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.961860 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.961957 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.962170 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.962265 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.962504 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.962602 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.962809 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.962907 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.963118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.963207 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.963422 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.963510 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.963726 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.963828 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.964028 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.964116 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.964334 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.964456 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.964650 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.964768 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.964958 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.965081 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.965386 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.965474 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.965699 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.965789 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.966009 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.966099 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.966340 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.966432 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.966655 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.966744 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.966960 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.967048 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.967277 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.967364 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.967595 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.967703 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.967903 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.967992 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.968278 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.968364 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.968598 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.968701 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.968891 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.968990 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.969205 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.969302 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.969533 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.969619 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.969838 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.969926 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.970145 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.970254 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.970474 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.970567 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.970790 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.970878 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.971098 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.971198 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.971402 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.971489 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.971730 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.971818 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.972041 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.972141 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.972368 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.972457 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.972789 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.972877 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.973103 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.973195 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.973412 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.973501 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.973739 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.973839 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.974065 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.974156 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.974414 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.974522 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.974724 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.974813 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.975041 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.975132 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.975354 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.975444 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.975703 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.975800 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.976022 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.976109 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.976333 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.976423 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.976650 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.976747 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.976963 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.977059 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.977278 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.977374 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.977597 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.977686 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.977906 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.978004 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.978227 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.978330 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.978578 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.978677 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.978898 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.978996 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.979231 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.979320 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.979588 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.979676 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.979913 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.980010 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.980218 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.980316 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.980528 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.980617 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.980857 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.980957 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.981146 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.981241 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.981450 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.981539 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.981772 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.981860 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.982074 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.982169 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.982411 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.982504 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.982724 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.982821 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.983034 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.983123 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.983338 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.983427 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.983643 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.983734 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.983953 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.984041 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.984259 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.984348 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.984564 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.984656 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.984882 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.984970 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.985190 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.985287 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.985527 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.985636 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.985827 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.985921 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.986150 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.986247 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.986484 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.986574 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.986791 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.986889 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.987098 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.987199 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.987402 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.987491 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.987714 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.987801 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.988024 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.988122 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.988335 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.988424 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.988664 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.988753 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.988978 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.989067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.989292 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.989387 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.989628 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.989718 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.989956 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.990091 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.990267 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.990421 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.990613 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.990701 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.990938 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.991029 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.991760 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.991856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.992067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.992158 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.992381 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.992472 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.992690 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.992786 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.992996 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.993091 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.993298 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.993386 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.993607 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.993702 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.993912 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.994009 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.994218 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.994445 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.994533 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.994655 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.994847 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.994984 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.995149 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.995252 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.995455 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.995551 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.995771 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.995865 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.996078 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.996166 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.996381 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.996469 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.996687 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.996777 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.997005 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.997093 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.997317 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.997414 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.997626 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.997723 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.997944 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.998031 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.998264 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.998371 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.998616 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.998708 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.998929 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.999036 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.999245 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.999333 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.999564 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.999653 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.999880 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:23.999970 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.000199 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.000301 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.000515 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.000615 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.000831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.000927 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.001149 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.001248 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.001465 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.001553 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.001778 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.001874 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.002100 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.002327 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.002434 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.002651 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.002763 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.002967 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.003282 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.003379 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.003595 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.003685 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.003911 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.004001 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.004225 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.004314 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.004538 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.004625 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.004853 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.004946 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.005166 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.005263 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.005481 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.005577 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.005798 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.005887 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.006115 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.006204 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.006457 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.006548 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.006839 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.007424 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.007657 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.007746 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.007990 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.008079 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.008310 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.008407 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.008631 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.008720 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.008952 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.009047 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.009274 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.009365 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.009591 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.009679 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.009910 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.009999 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.010228 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.010360 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.010571 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.010679 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.010891 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.010989 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.011202 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.011290 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.011517 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.011604 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.011830 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.011928 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.012144 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.012231 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.012452 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.012541 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.012771 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.012873 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.013084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.013172 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.013399 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.013487 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.013719 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.013810 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.014038 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.014126 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.014376 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.014480 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.014695 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.014785 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.015013 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.015110 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.015333 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.015533 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.015654 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.015846 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.015974 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.016181 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.016503 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.016591 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.016826 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.016915 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.017144 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.017233 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.017461 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.017558 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.017787 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.017876 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.018094 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.018183 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.018430 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.018540 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.018746 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.018834 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.019057 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.019146 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.019364 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.019465 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.019684 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.019780 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.019992 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.020080 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.020298 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.020395 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.020617 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.020704 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.020932 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.021019 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.021242 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.021466 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.021555 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.021813 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.021902 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.022132 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.022502 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.022610 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.022854 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.022950 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.023175 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.023262 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.023484 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.023574 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.023812 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.023909 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.024120 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.024209 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.024428 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.024527 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.024747 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.024843 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.025055 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.025155 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.025361 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.025450 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.025667 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.025755 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.025978 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.026074 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.026327 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.026432 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.026614 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.026711 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.026924 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.027022 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.027232 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.027321 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.027539 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.027626 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.027854 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.027945 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.028160 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.028255 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.028470 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.028568 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.028785 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.028923 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.029091 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.029179 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.029396 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.029489 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.029706 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.029803 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.030011 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.030108 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.030340 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.030518 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.030653 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.030794 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.030958 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.031046 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.031260 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.031356 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.031575 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.031665 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.031878 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.031966 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.032189 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.032294 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.032505 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.032602 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.032814 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.032903 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.033128 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.033232 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.033453 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.033541 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.033774 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.033865 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.034087 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.034190 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.034427 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.034518 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.034742 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.034839 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.035055 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.035157 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.035385 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.035473 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.035702 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.035797 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.036019 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.036237 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.036373 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.036572 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.036695 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.036898 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.037230 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.037326 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.037563 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.037652 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.037870 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.037959 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.038205 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.038316 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.038549 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.038651 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.038874 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.038971 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.039183 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.039273 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.039493 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.039581 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.039804 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.039971 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.040115 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.040205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.040424 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.040521 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.040738 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.040887 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.041043 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.041132 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.041352 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.041447 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.041661 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.041761 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.041969 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.042057 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.042306 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.042410 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.042609 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.042700 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.042918 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.043008 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.043229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.043324 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.043541 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.043630 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.043851 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.043939 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.044166 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.044256 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.044484 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.044581 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.044796 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.044891 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.045113 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.045212 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.045425 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.045522 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.045734 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.045831 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.046042 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.046141 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.046376 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.046475 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.046689 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.046778 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.047003 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.047105 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.047317 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.047415 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.047619 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.047706 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.047957 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.048047 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.048275 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.048364 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.048581 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.048669 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.048945 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.049079 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.049255 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.049344 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.049576 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.049665 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.049897 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.049988 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.050209 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.050344 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.050559 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.050703 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.050868 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.050957 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.051186 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.051273 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.051511 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.051610 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.051825 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.051915 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.052150 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.052247 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.052457 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.052555 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.052761 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.052851 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.053066 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.053167 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.053376 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.053474 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.054205 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.054382 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.054541 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.054639 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.054842 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.054932 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.055146 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.055270 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.055453 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.055543 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.055759 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.055855 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.056063 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.056152 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.056368 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.056466 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.056673 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.056763 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.056977 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.057064 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.057276 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.057373 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.057579 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.057667 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.057881 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.057977 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.058182 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.058329 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.058510 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.058598 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.058811 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.058900 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.059114 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.059215 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.059416 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.059506 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.059719 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.059809 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.060022 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.060121 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.060325 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.060415 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.060627 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.060715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.060930 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.061056 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.061237 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.061334 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.061544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.061641 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.061873 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.061971 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.062192 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.062303 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.062536 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.062624 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.062842 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.062939 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.063165 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.063256 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.063488 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.063577 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.063797 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.063894 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.064103 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.064195 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.064431 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.064528 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.064742 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.064830 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.065054 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.065142 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.065364 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.065469 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.065674 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.065763 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.065984 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.066081 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.066319 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.066469 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.066620 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.066709 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.066933 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.067022 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.067237 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.067335 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.067563 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.067653 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.067877 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.067964 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.068186 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.068284 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.068499 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.068656 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.068813 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.068904 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.069134 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.069260 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.069991 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.070081 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.070323 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.070432 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.070639 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.070736 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.070954 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.071044 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.071528 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.071636 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.071841 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.071930 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.072149 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.072245 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.072463 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.072563 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.072778 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.072866 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.073092 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.073179 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.073409 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.073509 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.073728 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.073819 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.074037 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.074132 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.074388 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.074493 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.074719 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.074808 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.075035 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.075123 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.075364 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.075506 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.075693 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.075791 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.076026 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.076115 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.076343 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.076434 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.076658 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.076747 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.076965 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.077062 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.077208 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 03:10:24.077298 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.077612 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.077921 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:10:24.078167 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 03:10:24.231884 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO dbcounter [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Registered counter for database nova_api Aug 25 03:10:24.233937 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO dbcounter [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Registered counter for database nova_api Aug 25 03:10:24.255360 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_db.sqlalchemy.engines [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.257961 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_db.sqlalchemy.engines [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.263055 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writer thread running {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.264494 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writer thread running {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.319756 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.context [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85016da6-52ca-4c0c-8aae-ef165990d859(cell1) {{(pid=106245) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 03:10:24.320277 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.context [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85016da6-52ca-4c0c-8aae-ef165990d859(cell1) {{(pid=106246) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 03:10:24.323942 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.324363 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_concurrency.lockutils [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.324458 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.324834 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_concurrency.lockutils [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.325993 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.326444 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_concurrency.lockutils [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.326774 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.327175 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_concurrency.lockutils [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.327266 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.327616 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_concurrency.lockutils [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.329206 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.329585 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_concurrency.lockutils [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.331247 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO dbcounter [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Registered counter for database nova_cell0 Aug 25 03:10:24.331582 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO dbcounter [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Registered counter for database nova_cell0 Aug 25 03:10:24.336874 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO dbcounter [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Registered counter for database nova_cell1 Aug 25 03:10:24.337023 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO dbcounter [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Registered counter for database nova_cell1 Aug 25 03:10:24.343953 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_db.sqlalchemy.engines [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.346196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_db.sqlalchemy.engines [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.347482 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_db.sqlalchemy.engines [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.350101 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_db.sqlalchemy.engines [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.352250 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writer thread running {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.353036 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writer thread running {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.357550 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writer thread running {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.492133 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writer thread running {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.499917 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO dbcounter [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Registered counter for database nova_cell0 Aug 25 03:10:24.500751 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO dbcounter [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Registered counter for database nova_cell0 Aug 25 03:10:24.509067 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_db.sqlalchemy.engines [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.510893 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG oslo_db.sqlalchemy.engines [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:10:24.513573 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writer thread running {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.515219 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writer thread running {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:10:24.912056 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: WARNING keystonemiddleware.auth_token [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:10:24.919424 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: WARNING keystonemiddleware.auth_token [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:10:24.921125 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: WARNING keystonemiddleware.auth_token [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:10:24.928384 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: WARNING keystonemiddleware.auth_token [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:10:25.271830 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: WARNING keystonemiddleware.auth_token [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:10:25.274963 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: WARNING keystonemiddleware.auth_token [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:10:25.277786 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: WARNING keystonemiddleware.auth_token [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:10:25.283029 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac3edcf9c0 pid: 106245 (default app) Aug 25 03:10:25.285114 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:25.286307 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Aug 25 03:10:25.286980 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu Aug 25 03:10:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:10:25.287565 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: WARNING keystonemiddleware.auth_token [None req-316a2b21-e72f-4184-a5c6-83b8a5b14651 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:10:25.293317 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac3edcf9c0 pid: 106246 (default app) Aug 25 03:11:46.607760 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:46.608749 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 25 03:11:46.609297 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:46.621509 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writing DB stats nova_api:SELECT=3 {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:46.622815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writing DB stats nova_cell0:SELECT=3 {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:46.623634 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writing DB stats nova_cell1:SELECT=3 {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:46.624894 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:47.473501 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-af4cf03d-1c6f-4f1e-8c3c-8eaf95c44888 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:47.505978 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-af4cf03d-1c6f-4f1e-8c3c-8eaf95c44888 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.889511 Aug 25 03:11:47.507496 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Aug 25 03:11:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:49.888229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:49.889302 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-803645ee-264e-4e9a-a6d8-517a802bf5c6 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 25 03:11:49.889712 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:50.327858 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-dc0f41ba-67d7-4cb8-a1bb-f1d0ff932e38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:50.445501 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-dc0f41ba-67d7-4cb8-a1bb-f1d0ff932e38 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.549000 Aug 25 03:11:50.449410 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:11:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:50.680190 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-964723b1-c029-4829-a51c-d1a1b60dcbdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:50.686505 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_api:SELECT=3 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:50.687324 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_cell1:SELECT=3 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:50.688538 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_cell0:SELECT=3 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:50.689429 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:50.833038 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-964723b1-c029-4829-a51c-d1a1b60dcbdd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.377561 Aug 25 03:11:50.833544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Aug 25 03:11:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:53.202603 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-dc0f41ba-67d7-4cb8-a1bb-f1d0ff932e38 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:53.203547 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-dc0f41ba-67d7-4cb8-a1bb-f1d0ff932e38 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 25 03:11:53.203962 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:53.852934 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-66c47832-cb5f-4a3d-9c6a-58fb40f74774 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:53.981201 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-66c47832-cb5f-4a3d-9c6a-58fb40f74774 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.770326 Aug 25 03:11:53.982026 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:11:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:53.994602 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-1a15a4de-2269-486c-96dd-cfaf3f9b4992 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:54.110492 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-1a15a4de-2269-486c-96dd-cfaf3f9b4992 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119879 Aug 25 03:11:54.119403 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Aug 25 03:11:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:56.493839 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-66c47832-cb5f-4a3d-9c6a-58fb40f74774 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:56.495518 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-66c47832-cb5f-4a3d-9c6a-58fb40f74774 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Aug 25 03:11:56.496127 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:56.906128 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b2870e38-e014-4eb3-958b-f40b8b6b98a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "swap": 0}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:56.991308 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b2870e38-e014-4eb3-958b-f40b8b6b98a8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487850 Aug 25 03:11:56.991968 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:11:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:57.003937 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-d8fb4163-ad8e-408d-86fb-6f9ad6e04bd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:57.082102 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-d8fb4163-ad8e-408d-86fb-6f9ad6e04bd7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081819 Aug 25 03:11:57.082724 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Aug 25 03:11:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:59.424124 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b2870e38-e014-4eb3-958b-f40b8b6b98a8 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:59.425142 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b2870e38-e014-4eb3-958b-f40b8b6b98a8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 25 03:11:59.425949 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:59.898381 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-0544eba5-34b6-45f9-b06e-b83e0fe7812b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "id": "d3", "vcpus": 2}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:00.048847 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-0544eba5-34b6-45f9-b06e-b83e0fe7812b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.616366 Aug 25 03:12:00.049548 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:11:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:00.062763 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-3031bd43-3b13-475d-9860-ddd9a42efa25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:00.162606 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-3031bd43-3b13-475d-9860-ddd9a42efa25 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103644 Aug 25 03:12:00.163303 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Aug 25 03:12:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:02.528890 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-0544eba5-34b6-45f9-b06e-b83e0fe7812b admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:02.529906 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-0544eba5-34b6-45f9-b06e-b83e0fe7812b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 25 03:12:02.530330 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:02.957215 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-1ea86df3-4492-4c83-8e42-3e3bc5cb30e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "disk": 20}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:03.043245 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-1ea86df3-4492-4c83-8e42-3e3bc5cb30e4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506683 Aug 25 03:12:03.043915 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:12:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:03.056533 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-3e9aa8eb-7831-4479-aa28-cad325f57118 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:03.149141 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-3e9aa8eb-7831-4479-aa28-cad325f57118 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096720 Aug 25 03:12:03.149728 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Aug 25 03:12:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:05.828158 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-1ea86df3-4492-4c83-8e42-3e3bc5cb30e4 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:05.829178 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-1ea86df3-4492-4c83-8e42-3e3bc5cb30e4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 25 03:12:05.829581 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:06.258877 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-3cbb65e4-2ece-4e4e-8685-9e3f9ab31fb9 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:06.283878 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-3cbb65e4-2ece-4e4e-8685-9e3f9ab31fb9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448045 Aug 25 03:12:06.284359 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Aug 25 03:12:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:08.631199 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-1ea86df3-4492-4c83-8e42-3e3bc5cb30e4 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:08.632114 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-1ea86df3-4492-4c83-8e42-3e3bc5cb30e4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 25 03:12:08.632545 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:09.028938 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-2bcd1fc9-8a08-47fa-8abb-be9bccb20a6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:09.100166 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-2bcd1fc9-8a08-47fa-8abb-be9bccb20a6d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460947 Aug 25 03:12:09.100756 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:12:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:09.115294 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-c1c085b1-72b3-4414-9177-d65eeeb59a1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:09.201533 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-c1c085b1-72b3-4414-9177-d65eeeb59a1c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089781 Aug 25 03:12:09.202044 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Aug 25 03:12:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:11.550737 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-2bcd1fc9-8a08-47fa-8abb-be9bccb20a6d admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:11.551763 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-2bcd1fc9-8a08-47fa-8abb-be9bccb20a6d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 25 03:12:11.552166 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:12.066166 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-8fac56b6-769b-485f-8708-80667ee42a30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:12.162377 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-8fac56b6-769b-485f-8708-80667ee42a30 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.603845 Aug 25 03:12:12.163890 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:12:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:12.176434 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-c1cb111a-05e4-4d71-8dfa-f4b2e8977706 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:12.285554 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-c1cb111a-05e4-4d71-8dfa-f4b2e8977706 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113244 Aug 25 03:12:12.286167 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Aug 25 03:12:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:14.668008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-8fac56b6-769b-485f-8708-80667ee42a30 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:14.669030 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-8fac56b6-769b-485f-8708-80667ee42a30 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 25 03:12:14.669442 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:15.141753 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-a092935c-4427-428a-8f53-01688741468c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "ram": 4096, "id": "3", "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:15.214502 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-a092935c-4427-428a-8f53-01688741468c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.538998 Aug 25 03:12:15.215742 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:12:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 03:12:15.227595 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-c6b62339-7adc-4641-9237-92781edceed1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:15.523947 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-c6b62339-7adc-4641-9237-92781edceed1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299784 Aug 25 03:12:15.524680 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Aug 25 03:12:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:17.932055 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-a092935c-4427-428a-8f53-01688741468c admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:17.933060 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-a092935c-4427-428a-8f53-01688741468c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 25 03:12:17.933738 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:18.366380 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-455a9727-6880-4e2b-90e1-4c45a63d3108 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:18.372513 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:18.437896 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-455a9727-6880-4e2b-90e1-4c45a63d3108 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498068 Aug 25 03:12:18.438871 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:12:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:18.451698 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-2ec26656-5a45-4901-8038-269b00000c3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:18.541371 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-2ec26656-5a45-4901-8038-269b00000c3a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093550 Aug 25 03:12:18.562307 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Aug 25 03:12:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:20.961560 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-455a9727-6880-4e2b-90e1-4c45a63d3108 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:20.962653 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-455a9727-6880-4e2b-90e1-4c45a63d3108 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 25 03:12:20.963224 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:21.475578 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-e7964ece-13ca-4434-8cd9-4c40967f3fb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "name": "m1.xlarge", "ram": 16384, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:21.700675 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-e7964ece-13ca-4434-8cd9-4c40967f3fb6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.731600 Aug 25 03:12:21.701403 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Aug 25 03:12:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:21.714236 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-4ac99bef-0f32-433c-9e82-28e96e857142 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:21.791780 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-4ac99bef-0f32-433c-9e82-28e96e857142 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082269 Aug 25 03:12:21.806308 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Aug 25 03:12:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:40.332034 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-e7964ece-13ca-4434-8cd9-4c40967f3fb6 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:40.333073 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-e7964ece-13ca-4434-8cd9-4c40967f3fb6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 25 03:12:40.333471 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:40.719114 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-89b8cdb6-2787-45dd-a455-1d0d1e52887b admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:40.737588 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-89b8cdb6-2787-45dd-a455-1d0d1e52887b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398019 Aug 25 03:12:40.738122 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Aug 25 03:12:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:41.816026 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-e7964ece-13ca-4434-8cd9-4c40967f3fb6 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:41.817062 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-e7964ece-13ca-4434-8cd9-4c40967f3fb6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 25 03:12:41.817493 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:42.343920 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-38794f46-e987-468a-b6cd-eaf3a0b01dcd admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:42.349456 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.wsgi [None req-38794f46-e987-468a-b6cd-eaf3a0b01dcd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-38794f46-e987-468a-b6cd-eaf3a0b01dcd admin admin] Request method failure captured: Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Accept: application/json Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Accept-Encoding: gzip, deflate Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Connection: keep-alive Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Content-Length: 0 Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Host: 10.222.0.58 Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Openstack-Api-Version: compute 2.90 Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Openstack-System-Scope: None Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: User-Agent: python-novaclient Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Auth-Token: gAAAAABjBuipF5YK8ZAMCmcz6HFVAilRRpA7iD_deF0L_Hxbt-qp013eJm1R22HHkpO8lMfU_sKEYCMEEUU01xO-65Qy7CIcSqc0a0uMB0NsRPyL5BykLN99A8NX3yTKXUx3qHYYgMhgUbOJPI6j0UuEjGP0-47cLS4cwSPZEXHvnxuZEbyM3v4 Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Domain-Id: None Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Domain-Name: None Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Identity-Status: Confirmed Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Is-Admin-Project: True Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Domain-Id: default Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Domain-Name: Default Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Name: admin Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Role: member,reader,admin Aug 25 03:12:42.353171 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Roles: member,reader,admin Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b981090d110a4dd99327dbd654b9daa9"}]}] Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant: admin Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant-Name: admin Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User: admin Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Domain-Id: default Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Domain-Name: Default Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Id: e8b708e7077c461bb73c230d7b1825fb Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Name: admin Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: method: > Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: exception: Flavor 42 could not be found. Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: action_args: {'id': '42'} Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:42.354901 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:42.355820 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.357008 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-38794f46-e987-468a-b6cd-eaf3a0b01dcd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:42.358585 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-38794f46-e987-468a-b6cd-eaf3a0b01dcd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398917 Aug 25 03:12:42.358585 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Aug 25 03:12:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:42.364367 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-60a87233-66b9-4a87-b648-5c8d9d392809 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:42.369309 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:42.387834 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-60a87233-66b9-4a87-b648-5c8d9d392809 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026987 Aug 25 03:12:42.388396 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Aug 25 03:12:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:42.398513 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-3f3f1696-c0ea-4677-82b7-b21650cd6f13 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:42.422691 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-3f3f1696-c0ea-4677-82b7-b21650cd6f13 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027702 Aug 25 03:12:42.423250 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Aug 25 03:12:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:42.433549 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-162d8e2f-dcef-421f-b6ea-b89f46876974 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:42.439202 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.wsgi [None req-162d8e2f-dcef-421f-b6ea-b89f46876974 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-162d8e2f-dcef-421f-b6ea-b89f46876974 admin admin] Request method failure captured: Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Accept: application/json Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Accept-Encoding: gzip, deflate Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Connection: keep-alive Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Content-Length: 0 Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Host: 10.222.0.58 Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Openstack-Api-Version: compute 2.90 Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Openstack-System-Scope: None Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: User-Agent: python-novaclient Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Auth-Token: gAAAAABjBuipF5YK8ZAMCmcz6HFVAilRRpA7iD_deF0L_Hxbt-qp013eJm1R22HHkpO8lMfU_sKEYCMEEUU01xO-65Qy7CIcSqc0a0uMB0NsRPyL5BykLN99A8NX3yTKXUx3qHYYgMhgUbOJPI6j0UuEjGP0-47cLS4cwSPZEXHvnxuZEbyM3v4 Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Domain-Id: None Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Domain-Name: None Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Identity-Status: Confirmed Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Is-Admin-Project: True Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Domain-Id: default Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Domain-Name: Default Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Name: admin Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Role: member,reader,admin Aug 25 03:12:42.442408 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Roles: member,reader,admin Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b981090d110a4dd99327dbd654b9daa9"}]}] Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant: admin Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant-Name: admin Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User: admin Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Domain-Id: default Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Domain-Name: Default Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Id: e8b708e7077c461bb73c230d7b1825fb Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Name: admin Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: method: > Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: exception: Flavor 42 could not be found. Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: action_args: {'id': '42'} Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:42.443862 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:42.444644 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:42.445715 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-162d8e2f-dcef-421f-b6ea-b89f46876974 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:42.448859 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-162d8e2f-dcef-421f-b6ea-b89f46876974 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014703 Aug 25 03:12:42.448859 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Aug 25 03:12:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:43.411872 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-3f3f1696-c0ea-4677-82b7-b21650cd6f13 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:43.412913 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-3f3f1696-c0ea-4677-82b7-b21650cd6f13 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 25 03:12:43.413447 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:43.933429 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-a7b90e0c-5789-4d05-9589-425eb53897ba admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:43.938756 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.wsgi [None req-a7b90e0c-5789-4d05-9589-425eb53897ba admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-a7b90e0c-5789-4d05-9589-425eb53897ba admin admin] Request method failure captured: Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Accept: application/json Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Accept-Encoding: gzip, deflate Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Connection: keep-alive Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Content-Length: 0 Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Host: 10.222.0.58 Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Openstack-Api-Version: compute 2.90 Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Openstack-System-Scope: None Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: User-Agent: python-novaclient Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Auth-Token: gAAAAABjBuir9HfSmgcJgaeLPo6udmlb3eC1efoiLQYxnlYaoQC_jj0S5SwfaK2zJdFOCLvTJCfqxA5A1JaYiqg6429NglNXjeCN01kso4zBKyWR_xiOT6kXLwXXhTyJnvFXjLSrxvqy9WzcZ2RJHVdrqsB5DFfQ7v0duApoTsVavbNjoJRC7vc Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Domain-Id: None Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Domain-Name: None Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Identity-Status: Confirmed Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Is-Admin-Project: True Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Domain-Id: default Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Domain-Name: Default Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Name: admin Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Role: member,reader,admin Aug 25 03:12:43.940338 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Roles: member,reader,admin Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b981090d110a4dd99327dbd654b9daa9"}]}] Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant: admin Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant-Name: admin Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User: admin Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Domain-Id: default Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Domain-Name: Default Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Id: e8b708e7077c461bb73c230d7b1825fb Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Name: admin Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: method: > Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: exception: Flavor 84 could not be found. Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: action_args: {'id': '84'} Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:43.941856 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:43.942827 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:43.944205 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-a7b90e0c-5789-4d05-9589-425eb53897ba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:43.945972 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-a7b90e0c-5789-4d05-9589-425eb53897ba admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389040 Aug 25 03:12:43.945972 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Aug 25 03:12:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:43.952268 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-54cd77db-5891-499a-bd12-30f536d69694 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:43.967805 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-54cd77db-5891-499a-bd12-30f536d69694 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019144 Aug 25 03:12:43.968326 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Aug 25 03:12:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:43.977551 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-52410e9e-d625-4ec3-b809-5d1b732d5a9d admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:43.993683 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-52410e9e-d625-4ec3-b809-5d1b732d5a9d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019605 Aug 25 03:12:43.994198 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Aug 25 03:12:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:44.003243 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-5596cba5-e178-4e9b-9dc4-35458dd2c99b admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:44.009040 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.wsgi [None req-5596cba5-e178-4e9b-9dc4-35458dd2c99b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-5596cba5-e178-4e9b-9dc4-35458dd2c99b admin admin] Request method failure captured: Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Accept: application/json Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Accept-Encoding: gzip, deflate Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Connection: keep-alive Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Content-Length: 0 Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Host: 10.222.0.58 Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Openstack-Api-Version: compute 2.90 Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Openstack-System-Scope: None Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: User-Agent: python-novaclient Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Auth-Token: gAAAAABjBuir9HfSmgcJgaeLPo6udmlb3eC1efoiLQYxnlYaoQC_jj0S5SwfaK2zJdFOCLvTJCfqxA5A1JaYiqg6429NglNXjeCN01kso4zBKyWR_xiOT6kXLwXXhTyJnvFXjLSrxvqy9WzcZ2RJHVdrqsB5DFfQ7v0duApoTsVavbNjoJRC7vc Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Domain-Id: None Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Domain-Name: None Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Identity-Status: Confirmed Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Is-Admin-Project: True Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Domain-Id: default Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Domain-Name: Default Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Name: admin Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Role: member,reader,admin Aug 25 03:12:44.010567 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Roles: member,reader,admin Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b981090d110a4dd99327dbd654b9daa9"}]}] Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant: admin Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant-Name: admin Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User: admin Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Domain-Id: default Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Domain-Name: Default Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Id: e8b708e7077c461bb73c230d7b1825fb Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Name: admin Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: method: > Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: exception: Flavor 84 could not be found. Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: action_args: {'id': '84'} Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:44.012118 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:44.013067 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:44.014342 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-5596cba5-e178-4e9b-9dc4-35458dd2c99b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:44.015597 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-5596cba5-e178-4e9b-9dc4-35458dd2c99b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012177 Aug 25 03:12:44.015597 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Aug 25 03:12:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:44.973840 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-52410e9e-d625-4ec3-b809-5d1b732d5a9d admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:44.974874 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-52410e9e-d625-4ec3-b809-5d1b732d5a9d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 25 03:12:44.975269 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:45.490352 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-7f0a50df-d7e3-46a8-8dea-a72a1d775b24 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.496672 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.wsgi [None req-7f0a50df-d7e3-46a8-8dea-a72a1d775b24 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-7f0a50df-d7e3-46a8-8dea-a72a1d775b24 admin admin] Request method failure captured: Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Accept: application/json Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Accept-Encoding: gzip, deflate Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Connection: keep-alive Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Content-Length: 0 Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Host: 10.222.0.58 Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Openstack-Api-Version: compute 2.90 Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Openstack-System-Scope: None Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: User-Agent: python-novaclient Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Auth-Token: gAAAAABjBuisn_XIH1nIjmEfatJu6JKV6PNyns2DfwZQMrRgyX5w3vWWC1UJSKNb98_-7OfrG_yCbt-phrFLe75U6xxjIuEAeEgXdsQpoXL9khtdpcUwr9KfCYvM2D1mptDyQqJ2_62Im1m4ZV1cs_ICoITbCTdupHFsMGejVDGHVZ-Vxc1YZuU Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Domain-Id: None Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Domain-Name: None Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Identity-Status: Confirmed Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Is-Admin-Project: True Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Domain-Id: default Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Domain-Name: Default Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Project-Name: admin Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Role: member,reader,admin Aug 25 03:12:45.498196 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Roles: member,reader,admin Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b981090d110a4dd99327dbd654b9daa9"}]}] Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant: admin Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-Tenant-Name: admin Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User: admin Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Domain-Id: default Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Domain-Name: Default Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Id: e8b708e7077c461bb73c230d7b1825fb Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: X-User-Name: admin Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: method: > Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: exception: Flavor 451 could not be found. Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: action_args: {'id': '451'} Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:45.499831 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:45.500701 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.501815 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-7f0a50df-d7e3-46a8-8dea-a72a1d775b24 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:45.503564 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-7f0a50df-d7e3-46a8-8dea-a72a1d775b24 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387277 Aug 25 03:12:45.503564 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:45.510156 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-2c5ae166-45e1-4c2b-a3b7-452969feaf5a admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.524931 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-2c5ae166-45e1-4c2b-a3b7-452969feaf5a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019071 Aug 25 03:12:45.525452 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:45.534720 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.549781 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018596 Aug 25 03:12:45.550313 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:12:45.559847 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-3a144754-3f6a-4ca4-b41a-c2f75191b27a admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.565040 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.wsgi [None req-3a144754-3f6a-4ca4-b41a-c2f75191b27a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-3a144754-3f6a-4ca4-b41a-c2f75191b27a admin admin] Request method failure captured: Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Accept: application/json Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Accept-Encoding: gzip, deflate Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Connection: keep-alive Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Content-Length: 0 Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Host: 10.222.0.58 Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Openstack-Api-Version: compute 2.90 Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Openstack-System-Scope: None Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: User-Agent: python-novaclient Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Auth-Token: gAAAAABjBuisn_XIH1nIjmEfatJu6JKV6PNyns2DfwZQMrRgyX5w3vWWC1UJSKNb98_-7OfrG_yCbt-phrFLe75U6xxjIuEAeEgXdsQpoXL9khtdpcUwr9KfCYvM2D1mptDyQqJ2_62Im1m4ZV1cs_ICoITbCTdupHFsMGejVDGHVZ-Vxc1YZuU Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Domain-Id: None Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Domain-Name: None Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Identity-Status: Confirmed Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Is-Admin-Project: True Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Domain-Id: default Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Domain-Name: Default Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Project-Name: admin Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Role: member,reader,admin Aug 25 03:12:45.566544 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Roles: member,reader,admin Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b981090d110a4dd99327dbd654b9daa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b981090d110a4dd99327dbd654b9daa9"}]}] Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant: admin Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant-Id: b981090d110a4dd99327dbd654b9daa9 Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-Tenant-Name: admin Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User: admin Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Domain-Id: default Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Domain-Name: Default Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Id: e8b708e7077c461bb73c230d7b1825fb Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: X-User-Name: admin Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: method: > Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: exception: Flavor 451 could not be found. Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: action_args: {'id': '451'} Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:45.568084 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:45.569229 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: ERROR nova.api.openstack.wsgi Aug 25 03:12:45.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-3a144754-3f6a-4ca4-b41a-c2f75191b27a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:45.572102 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-3a144754-3f6a-4ca4-b41a-c2f75191b27a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011546 Aug 25 03:12:45.572102 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 03:12:46.528738 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:46.529747 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 25 03:12:46.530138 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:47.054051 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-22f04a0b-c3cf-48a7-a1cb-ac4b8583ed9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:47.110766 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-22f04a0b-c3cf-48a7-a1cb-ac4b8583ed9d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.443979 Aug 25 03:12:47.111330 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Aug 25 03:12:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:48.087533 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:48.088591 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 25 03:12:48.090180 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:48.608106 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-f74a5293-d54b-487c-b754-85026723c6d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:48.693580 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-f74a5293-d54b-487c-b754-85026723c6d4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.464366 Aug 25 03:12:48.694144 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Aug 25 03:12:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:49.658466 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:49.659402 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 25 03:12:49.659797 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:50.182765 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-ec5ad1f7-24d6-43b5-85f1-f545ea1ba907 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:50.282699 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-ec5ad1f7-24d6-43b5-85f1-f545ea1ba907 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.483494 Aug 25 03:12:50.283270 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Aug 25 03:12:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 03:12:51.261231 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:51.262232 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 25 03:12:51.262660 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:51.789546 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-4bfbd917-d03e-4926-b2ce-cec2c81cafdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:51.859567 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-4bfbd917-d03e-4926-b2ce-cec2c81cafdd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458880 Aug 25 03:12:51.860136 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Aug 25 03:12:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:52.842714 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:52.843724 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 25 03:12:52.844129 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:12:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:53.361757 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-b62ffcae-adda-447b-9fe3-e02cbd37b660 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:53.381842 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-b62ffcae-adda-447b-9fe3-e02cbd37b660 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400612 Aug 25 03:12:53.382395 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu Aug 25 03:12:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:47.640890 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:47.641908 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b3dac18c-592e-41a5-a818-8b451c9da363 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 25 03:13:47.642393 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Thu Aug 25 03:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:13:47.653410 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:48.029199 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-ef8e9526-574b-4890-b025-0f799a48bd18 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:48.050064 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-ef8e9526-574b-4890-b025-0f799a48bd18 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401084 Aug 25 03:13:48.050648 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Aug 25 03:13:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:48.072522 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG dbcounter [-] [106246] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:48.076195 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-b5332b01-5ddc-4e84-a39f-499223099a8a admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:48.083637 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-b5332b01-5ddc-4e84-a39f-499223099a8a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012801 Aug 25 03:13:48.084146 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Thu Aug 25 03:13:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:48.095699 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-230762a4-1cff-4169-8709-d5add5b03d9f admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:48.103578 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-230762a4-1cff-4169-8709-d5add5b03d9f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011550 Aug 25 03:13:48.104097 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Thu Aug 25 03:13:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:48.115616 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:48.123882 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011840 Aug 25 03:13:48.124509 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Thu Aug 25 03:13:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:48.136730 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-5c51f68b-9256-4775-b94a-d7535c03c874 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:48.144436 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-5c51f68b-9256-4775-b94a-d7535c03c874 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011934 Aug 25 03:13:48.144956 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Thu Aug 25 03:13:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:51.679417 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:51.680422 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 25 03:16:51.680814 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:51.823144 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_api:SELECT=6 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:51.983540 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:51.986983 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:51.987454 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:51.987880 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:51.988590 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:51.989029 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:51.989446 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:52.022747 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-74dd2550-d754-473a-bb5c-5a3131c080a6 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201388 Aug 25 03:16:52.023231 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Aug 25 03:16:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:16:52.853562 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:52.854594 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 25 03:16:52.854998 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:53.050158 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:53.053757 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:53.054230 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:53.054696 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:53.055403 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:53.055843 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:53.056258 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:53.076575 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-f4b55d2c-e3ca-4d4a-917c-361894a41bb7 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079214 Aug 25 03:16:53.077342 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Aug 25 03:16:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:17:04.343341 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:04.344347 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 25 03:17:04.344745 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:17:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:17:04.492200 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_cell0:SELECT=4 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:04.492923 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_cell1:SELECT=4 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:04.493540 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG dbcounter [-] [106245] Writing DB stats nova_api:SELECT=8 {{(pid=106245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:04.543925 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:04.547331 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:04.547791 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:04.548288 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:04.548976 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:04.549413 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:04.549823 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:04.575030 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-ada85b25-7f31-4aef-95c3-595f3da91312 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087182 Aug 25 03:17:04.575597 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Aug 25 03:17:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:17:05.404881 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: DEBUG nova.api.openstack.wsgi [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] Calling method '>' {{(pid=106246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:05.405885 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: INFO nova.api.openstack.requestlog [None req-0b3c42be-95f8-440f-aa57-443034a144d3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 25 03:17:05.406332 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: [pid: 106246|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Aug 25 03:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:17:05.597505 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG nova.api.openstack.wsgi [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] Calling method '>' {{(pid=106245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:05.600860 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.601355 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.601774 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.602503 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.602938 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.603349 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: DEBUG oslo_concurrency.lockutils [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.625266 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: INFO nova.api.openstack.requestlog [None req-d158260a-1cb9-4808-8461-d5f3c7a30b94 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079319 Aug 25 03:17:05.625747 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: [pid: 106245|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Aug 25 03:17:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:18:04.560071 dv-cinder-851640-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 25 03:18:04.561044 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: Thu Aug 25 03:18:04 2022 - graceful shutdown triggered... Aug 25 03:18:04.561528 dv-cinder-851640-5-iscsi devstack@n-api.service[106245]: Gracefully killing worker 1 (pid: 106245)... Aug 25 03:18:04.561890 dv-cinder-851640-5-iscsi devstack@n-api.service[106246]: Gracefully killing worker 2 (pid: 106246)... Aug 25 03:18:05.562207 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: worker 1 buried after 1 seconds Aug 25 03:18:05.562810 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: worker 2 buried after 1 seconds Aug 25 03:18:05.562810 dv-cinder-851640-5-iscsi devstack@n-api.service[106244]: goodbye to uWSGI. Aug 25 03:18:05.563854 dv-cinder-851640-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 25 03:18:05.564396 dv-cinder-851640-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 25 03:18:05.567235 dv-cinder-851640-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 03:18:05.582919 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 03:18:05 2022] *** Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: nodename: dv-cinder-851640-5-iscsi Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: machine: x86_64 Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: clock source: unix Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: pcre jit disabled Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: detected number of CPU cores: 4 Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: current working directory: / Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: detected binary path: /usr/bin/uwsgi-core Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: your processes number limit is 47680 Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: your memory page size is 4096 bytes Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: detected max file descriptor number: 2048 Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: lock engine: pthread robust mutexes Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: thunder lock: enabled Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 03:18:05.583473 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 03:18:05.623048 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: Python main interpreter initialized at 0x555a4d1f79c0 Aug 25 03:18:05.623048 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: python threads support enabled Aug 25 03:18:05.623048 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: your server socket listen backlog is limited to 100 connections Aug 25 03:18:05.623048 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: your mercy for graceful operations on workers is 90 seconds Aug 25 03:18:05.623512 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 03:18:05.623512 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: *** Operational MODE: preforking *** Aug 25 03:18:05.623770 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: *** uWSGI is running in multiple interpreter mode *** Aug 25 03:18:05.623770 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: spawned uWSGI master process (pid: 121260) Aug 25 03:18:05.623976 dv-cinder-851640-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 03:18:05.624660 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: spawned uWSGI worker 1 (pid: 121277, cores: 1) Aug 25 03:18:05.624911 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: spawned uWSGI worker 2 (pid: 121278, cores: 1) Aug 25 03:18:05.625061 dv-cinder-851640-5-iscsi devstack@n-api.service[121260]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 03:18:06.295567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 03:18:06.296209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 03:18:07.470420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:18:07.470420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: from cryptography.utils import int_from_bytes Aug 25 03:18:07.471066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:18:07.471066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: from cryptography.utils import int_from_bytes Aug 25 03:18:07.472996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:18:07.472996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: from cryptography.utils import int_from_bytes Aug 25 03:18:07.473450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:18:07.473450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: from cryptography.utils import int_from_bytes Aug 25 03:18:09.914468 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 03:18:09.915076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 03:18:09.915334 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 03:18:09.915653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 03:18:09.915911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 03:18:09.916307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.916640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.916965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.917293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.917793 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.918111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.918470 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.919361 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.919700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.919969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.920289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.920620 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-5-iscsi {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.920949 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.921261 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.921577 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.921894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.922203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.922563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.922877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.923387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.924754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.924754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.924754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.925160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.925437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.925739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.926065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.926417 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.926737 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.927043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.927462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-5-iscsi {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.927781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.928093 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.928411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.928842 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.929168 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.929479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.929795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.930122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.930492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.930797 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.931109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.931430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.931755 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.932062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.932371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.932683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.933003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.933314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.933621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.933873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.934188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.934569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.934894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.935216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.935472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.935725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.936048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.936369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.936683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.936994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.937301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.937618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.937930 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.938237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.938569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.938892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.939201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.939518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.939841 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.940150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.940472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.940874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.941587 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.941587 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.941820 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.942061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.942392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.942711 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.943205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.943339 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.943640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.943950 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.944273 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.944609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.944917 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.945148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 03:18:09.945542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.945635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 03:18:09.945714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.945792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.945965 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 03:18:09.946113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.946323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 03:18:09.946539 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.946690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 03:18:09.946843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.946989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.947239 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.947400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.947548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.947720 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.947876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.948292 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.948450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.948622 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.948767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.948910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.949054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.949196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.949338 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.949498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.949651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.949802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.949947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.950089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.950343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.950510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.950679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.950833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.950992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-5-iscsi {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.951144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.951305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.951456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.951608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.951761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.951913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.952066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.952224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.952376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.952528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.952697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.952849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.953013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.953168 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.953321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.953472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.953631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.953820 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.954391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.954783 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.954934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.955107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.955261 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.955406 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.956002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.956167 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.956322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.956553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.956878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.957051 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.957194 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.957345 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.957494 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.957649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.957811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.957960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.958112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.958253 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.958253 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.958553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-5-iscsi {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.958701 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.958841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.958979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.959130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.959280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.959428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.959726 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.959726 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.960003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.960756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.960906 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.961050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.961218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.961366 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.961507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.961660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.961808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.961947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.962091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.962241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.962458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.962601 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.962750 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.962895 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.963042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.963188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.963338 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.963486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.963627 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.963772 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.963919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.964079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.964387 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.964487 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.964581 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.964673 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.964766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.964862 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.964961 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.964961 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.965130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.965215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.965305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.965403 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.966036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.966190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.966362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.966481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.966570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.966951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.967045 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.967143 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.967236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.967329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.967424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.967517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.967602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.967685 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.967777 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.967870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.967964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.968057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.968149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.968149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.968313 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.968313 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.968490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.968576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.968667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.968759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.968852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.969103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.969211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.969307 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.969394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.969485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.969571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.969664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.969778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.969972 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.970074 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.970314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.970411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.970685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.970783 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.970975 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.971104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.971291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.971396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.971637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.971733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.971953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.972054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.972273 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.972374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.972588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.972680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.972916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.973049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.973280 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.973517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.973638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.973843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.973953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.974163 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.974346 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.974557 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.974663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.974870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.974972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.975121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.975293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.975605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.975711 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.975923 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.976030 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.976242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.976349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.977663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.977749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.977824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.977893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.977969 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.978050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.978129 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.978200 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.978304 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.978384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.978454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.978540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.978613 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.978682 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.978751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.978826 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.979148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.979323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.979410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.979709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.979809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.979920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.980014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.980107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.980287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.980399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.980623 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.980723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.980957 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.981071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.981825 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.981921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.982153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.982246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.982505 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.982638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.982818 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.982916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.983134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.983293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.983448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.983550 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.983756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.983857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.984080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.984184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.984394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.984487 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.984708 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.984825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.985033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.985160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.985373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.985488 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.985652 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.985773 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.985976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.986093 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.986310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.986435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.986615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.986756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.986995 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.987279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.987388 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.987477 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.987570 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.987695 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.987841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.988017 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.988150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.988334 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.988460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.988671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.988765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.989008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.989100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.989318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.989412 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.989647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.989748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.989971 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.990063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.990304 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.990409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.990617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.990719 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.990925 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.991016 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.991232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.991322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.991541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.991636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:18:09.991852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.991952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.992166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.992272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.992473 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.992574 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.992781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.992874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.993089 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.993195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.993398 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.993500 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.993706 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.993841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.994033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.994141 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.994368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.994464 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.994705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.994811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.995013 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.995108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.995322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.995429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.995672 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.995778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.995982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.996077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.996323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.996445 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.996659 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.996804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.997025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.997137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.997356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.997463 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.997671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.997782 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.997989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.998099 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.998326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.998428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.998647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.998766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.998962 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.999108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.999275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.999418 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.999598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.999755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:09.999906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.000044 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.000223 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.000364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.000542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.000672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.000868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.000971 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.001184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.001504 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.001668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.001824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.001974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.002118 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.002259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.002473 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.002634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.002781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.002920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.003111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.003214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.003431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.003533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.003743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.003845 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.004060 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.004155 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.004376 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.004480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.004710 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.004801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.005007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.005098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.005318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.005410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.005646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.005805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.005959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.006052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.006377 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.006479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.006625 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.006721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.006962 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.007071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.007258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.007371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.007577 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.007686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.007883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.007989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.008197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.008295 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.008509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.008601 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.008823 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.008927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.009135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.009225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.009454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.009545 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.009768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.009872 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.010080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.010179 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.010419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.010527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.010737 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.010830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.011050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.011141 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.011360 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.011450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.011676 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.011777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.011995 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.012085 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.012323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.012441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.012648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.012741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.012968 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.013060 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.013287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.013378 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.013602 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.013701 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.013910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.014000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.014220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.014349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.014561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.014661 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.014889 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.015053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.015201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.015352 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.015494 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.015633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.015806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.015959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.016125 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.016278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.016420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.016566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.016742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.016835 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.017061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.017191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.017369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.017471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.017679 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.017784 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.017992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.018138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.018354 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.018448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.018669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.018762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.018980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.019073 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.019302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.019401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.019628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.019726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.019944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.020044 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.020252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.020348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.020566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.020664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.020873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.020965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.021190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.021281 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.021500 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.021598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.021811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.021902 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.022117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.022207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.022454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.022567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.022770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.022871 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.023078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.023167 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.023389 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.023494 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.023729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.023826 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.024045 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.024137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.024363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.024464 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.024675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.024764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.024990 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.025163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.025319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.025472 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.025616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.025924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.026086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.026231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.026356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.026553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.026648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.026879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.026981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.027207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.027319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.027556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.027675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.027874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.028561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.028727 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.028878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.029019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.029166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.029315 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.029456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.029624 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.029765 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.029940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.030089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.030236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.030367 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.030577 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.030670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.030887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.030978 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.031199 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.031291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.031510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.031609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.031824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.031922 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.032130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.032221 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.032442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.032552 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.032748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.032853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.033055 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.033192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.033374 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.033474 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.033685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.033796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.034002 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.034100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.034328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.034437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.034657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.034821 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.034969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.035083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.035280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.035391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.035588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.035692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.035897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.036004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.036218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.036309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.036535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.036635 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.036864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.036956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.037180 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.037266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.037504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.037591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.037818 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.037934 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.038125 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.038236 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.038485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.038593 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.038826 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.038935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.039144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.039246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.039448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.039538 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.039762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.039855 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.040075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.040177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.040381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.040480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.040695 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.040786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.041006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.041111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.041318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.041409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.041632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.041724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.041939 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.042041 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.042252 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.042375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.042581 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.042673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.042892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.042993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.043203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.043302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.043512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.044210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.044363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.044466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.044676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.044774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.044988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.045079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.045355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.045467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.045606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.045708 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.045914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.046014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.046237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.046396 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.046567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.046673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.046875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.046978 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.047184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.047324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.047498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.047600 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.047810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.047921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.048114 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.048214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.048417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.048508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.048824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.048940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.049051 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.049145 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.049370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.049462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.049687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.049793 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.049996 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.050098 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.050320 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.050419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.050639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.050748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.050955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.051069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.051283 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.051385 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.051582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.051675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.051897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.051991 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.052206 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.052307 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.052517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.052619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.052825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.052927 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.053139 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.053242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.053444 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.053545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.053754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.053846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.054063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.054163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.054391 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.054488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.054702 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.054804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.055016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.055126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.055331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.055431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.055640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.055742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.055951 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.056244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.056351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.056558 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.056652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.056885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.056988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.057214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.057317 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.057542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.057636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.057865 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.058063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.058238 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.058363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.058527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.058726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.058904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.059046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.059189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.059365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.059508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.059671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.059815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.059956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.060108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.060257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.060399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.060547 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.060695 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.060844 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.060992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.061132 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.061288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.061450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.061607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.061755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.061904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.062051 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.062201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.062375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.062522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.062671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.062839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.062990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.063145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.063293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.063452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.063601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.063742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.063883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.064034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.064183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.064332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.064479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.064645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.064797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.064961 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.065111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.065272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.065430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.065571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.065788 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.065940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.066081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.066223 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.066425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.066522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.066624 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.066805 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.066908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.067122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.067216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.067452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.067563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.067762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.067863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.068079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.068193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.068393 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.068519 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.068713 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.068824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.069024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.069123 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.069339 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.069433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.069648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.069739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.069955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.070087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.070273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.070415 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.070612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.070734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.070930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.071046 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.071250 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.071351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.071568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.071669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.071886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.071993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.072196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.072280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.072517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.072601 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.072833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.073270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.073407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.073562 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.073718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.073879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.074035 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.074197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.074376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.074532 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.074688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.074861 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.075032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.075180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.075344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.075508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.075667 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.075819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.075979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.076130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.076288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.076506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.076637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.076770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.076890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.077080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.077202 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.077405 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.077508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.077828 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.077935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.078161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.078272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.078507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.078628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.078793 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.078952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.079111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.079201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.079423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.079569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.079723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.079879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.080020 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.080159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.080351 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.080495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.080676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.080815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.080986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.081130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.081303 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.081448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.081603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.081745 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.081918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.082062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.082229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.082349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.082573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.082668 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.082885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.082988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.083195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.083320 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.083510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.083625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.083821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.083920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.084129 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.084255 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.084455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.084549 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.084772 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.084873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.085084 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.085190 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.085394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.085486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.085703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.085809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.086053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.086168 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.086386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.086482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.086737 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.086851 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.087047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.087141 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.087359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.087459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.087684 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.087788 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.087993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.088092 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.088309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.088408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.088630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.088794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.088959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.089102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.089245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.089394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.089542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.089692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.089843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.090002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.090150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.090329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.090989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.091160 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.091319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.091404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.091647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.091730 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.091970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.092123 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.092267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.092414 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.092592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.092738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.092905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.093063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.093211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.093353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.093491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.093629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.093804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.093957 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.094130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.094332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.094479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.094630 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.094784 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.094939 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.095093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.095245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.095394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.095619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.095769 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.095918 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.096058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.096195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.096345 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.096508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.096650 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.096770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.096937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.097081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.097237 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.097386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.097528 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.097677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.097816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.097964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.098135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.098308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.098484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.098608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.098803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.098912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.099115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.099209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.099429 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.099527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.099736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.099829 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.100043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.100173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.100351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.100484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.100675 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.100804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.100983 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.101120 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.101309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.101441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.101623 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.101762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.101932 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.102079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.102241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.102430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.102583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.102746 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.102929 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.103177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.103340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.103496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.103597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.103816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.103911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.104136 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.104235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.104448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.104550 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.104761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.104854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.105081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.105179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.105397 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.105503 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.105712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.105807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.106024 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.106753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.106995 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.107107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.107232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.107312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.107546 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.107645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.107864 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.107976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.108185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.108278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.108598 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.108720 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.108908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.109061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.109337 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.109529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.109658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.109849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.110003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.110146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.110320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.110415 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.110630 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.110736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.110947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.111042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.111260 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.111360 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.111578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.111688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.111895 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.111991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.112228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.112322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.112554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.112660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.112871 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.112973 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.113196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.113297 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.113509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.113613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.113827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.113920 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.114146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.114240 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.114490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.114588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.114819 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.114921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.115159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.115250 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.115470 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.115573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.115788 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.115891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.116107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.116200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.116424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.116519 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.116741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.116842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.117062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.117183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.117369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.117480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.117685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.117787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.118000 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.118103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.118335 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.118446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.118665 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.118756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.118979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.119153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.119302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.119483 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.119623 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.119783 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.119919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.120071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.120220 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.120360 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.120507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.120656 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.120805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.120950 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.121131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.121363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.121530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.121692 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.121872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.122039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.122185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.122389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.122538 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.122721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.122875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.123044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.123191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.123363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.123514 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.123676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.123827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.123988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.124131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.124280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.124424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.124600 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.124750 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.124915 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.125063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.125224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.125371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.125598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.125739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.125879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.126015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.126208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.126391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.126502 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.126591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.126791 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.126892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.127207 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.127402 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.127538 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.127757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.127857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.128080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.128183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.128413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.128514 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.128746 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.128861 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.129051 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.129139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.129361 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.129460 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.129676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.129768 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.129986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.130077 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.130309 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.130413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.130625 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.130707 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.130942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.131057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.131246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.131337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.131556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.131655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.131872 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.131976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.132185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.132284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.132493 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.132585 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.132800 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.132904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.133106 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.133198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.133436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.133529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.133747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.133854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.134057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.134149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.134388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.134483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.134709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.134810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.135019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.135119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.135328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.135428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.135639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.135732 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.135947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.136039 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.136264 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.136366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.136575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.136679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.136886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.136976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.137203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.137309 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.137538 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.137653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.137848 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.137948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.138162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.138410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.138521 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.138762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.138915 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.139091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.139223 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.139419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.139576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.139747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.139906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.140062 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.140201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.140450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.140613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.140762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.140911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.141043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.141191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.141340 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.141489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.141639 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.141799 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.141946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.142148 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.142392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.142536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.142691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.142834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.142981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.143132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.143272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.143470 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.143616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.143764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.143923 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.144076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.144217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.144364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.144504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.144694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.144849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.145014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.145153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.145324 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.145588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.145687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.145794 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.145942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.146037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.146257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.146386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.146594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.146700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.146944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.147047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.147266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.147374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.147583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.147687 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.147900 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.148006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.148214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.148315 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.148529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.148623 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.148845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.148952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.149167 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.149270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.149485 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.149582 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.150200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.150342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.150434 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.150535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.150632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.150719 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.150803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.151001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.151100 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.151392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.151489 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.151705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.151798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.152017 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.152112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.152331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.152449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.152653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.152768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.153484 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.153604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.153810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.153913 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.154123 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.154226 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.154472 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.154586 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.154794 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.154896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.155114 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.155216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.155427 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.155618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.155758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.155854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.156077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.156170 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.156392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.156503 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.156722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.156829 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.157040 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.157135 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.157352 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.157656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.157750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.158015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.158122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.158362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.158480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.158692 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.158810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.159022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.159125 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.159501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.159609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.159696 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.159792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.159919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.160015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.160242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.160341 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.160557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.160652 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.160867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.160960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.161175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.161271 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.161491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.161594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.161800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.161894 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.162108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.162216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.162442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.162555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.162753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.162856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.163066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.163175 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.163373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.163475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.163681 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.163787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.163988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.164092 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.164295 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.164399 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.164649 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.164766 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.164910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.165004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.165221 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.165314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.165530 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.165638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.165840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.165941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.166147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.166247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.166479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.166597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.166787 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.166897 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.167103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.167205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.167416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.167518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.167739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.167851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.168056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.168182 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.168370 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.168493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.169285 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.169399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.169614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.169716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.169928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.170035 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.170241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.170375 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.170591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.170694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.170910 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.171014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.171242 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.171336 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.171560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.171663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.171877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.171978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.172192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.172293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.172509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.172614 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.172827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.173080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.173175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.173423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.173525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.173750 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.173845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.174061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.174163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.174414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.174537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.174738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.174847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.175052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.175144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.175365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.175468 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.175677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.175778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.176007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.176101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.176323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.176446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.176639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.176742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.176956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.177060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.177272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.177375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.177586 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.177688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.177903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.178004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.178219 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.178373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.178562 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.178657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.178882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.178976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.179198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.179307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.179521 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.179652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.179842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.180007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.180161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.180310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.180469 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.180568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.180789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.180941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.181119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.181274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.181447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.181570 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.181770 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.181880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.182096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.182190 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.182439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.182547 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.182757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.182883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.183067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.183161 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.183313 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 03:18:10.183452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.183691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.184026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.184377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.184690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.185116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.185435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.185762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.186088 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.186429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.186759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.187090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.187405 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.187738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.188055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.188394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.188743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.189074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.189406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.189718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.190032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.190365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.190686 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.191009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.191327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.191639 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.191950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.192267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.192586 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.192898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.193214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.193524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.193838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.194146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.194482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.194796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.195106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.195416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.195727 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.196042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.196353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.196666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.196979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.197290 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.197599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.197938 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.198644 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.198966 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.199298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.199643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.199973 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.200294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.200624 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.200954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.201278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.201599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.201940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.202259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.202610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.202930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.203250 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.203566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.203885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.204219 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.204540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.204856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.205187 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.205512 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.205840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.206164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.206511 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.206851 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.207171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.207490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.207808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.208127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.208444 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.208766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.209083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.209401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.209754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.210042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.210401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.210737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.211057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.211389 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.211724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.212079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.212401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.212752 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.213086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.213409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.213726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.214037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:18:10.214303 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 03:18:10.245164 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Registered counter for database nova_api Aug 25 03:18:10.265805 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.272497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.277016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO dbcounter [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Registered counter for database nova_api Aug 25 03:18:10.297563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_db.sqlalchemy.engines [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.303983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writer thread running {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.328976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.context [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85016da6-52ca-4c0c-8aae-ef165990d859(cell1) {{(pid=121277) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 03:18:10.333083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:10.333568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:10.335208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:10.335947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:10.336401 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:10.338413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:10.340392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Registered counter for database nova_cell0 Aug 25 03:18:10.344913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Registered counter for database nova_cell1 Aug 25 03:18:10.352211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.353847 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.358985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.360783 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.context [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85016da6-52ca-4c0c-8aae-ef165990d859(cell1) {{(pid=121278) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 03:18:10.364918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:10.365403 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:10.367046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:10.367796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:10.368248 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:10.370251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:10.372357 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO dbcounter [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Registered counter for database nova_cell0 Aug 25 03:18:10.376352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO dbcounter [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Registered counter for database nova_cell1 Aug 25 03:18:10.384645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_db.sqlalchemy.engines [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.387211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_db.sqlalchemy.engines [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.391975 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writer thread running {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.397705 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writer thread running {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.498141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.507933 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO dbcounter [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Registered counter for database nova_cell0 Aug 25 03:18:10.515251 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_db.sqlalchemy.engines [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.519710 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writer thread running {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.544286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO dbcounter [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Registered counter for database nova_cell0 Aug 25 03:18:10.553394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_db.sqlalchemy.engines [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:18:10.558200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writer thread running {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:18:10.847744 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:18:10.855610 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:18:10.889974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: WARNING keystonemiddleware.auth_token [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:18:10.897448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: WARNING keystonemiddleware.auth_token [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:18:11.212456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:18:11.219180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: WARNING keystonemiddleware.auth_token [None req-d064acbf-adb8-45ba-9296-5127f1c104c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:18:11.224477 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a4d1f79c0 pid: 121277 (default app) Aug 25 03:18:11.249158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: WARNING keystonemiddleware.auth_token [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:18:11.255242 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: WARNING keystonemiddleware.auth_token [None req-12f5bec6-9f97-459a-9485-aebec4e9465c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:18:11.260609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a4d1f79c0 pid: 121278 (default app) Aug 25 03:18:47.091319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:47.092124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:47.093051 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:47.093976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:47.201230 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:47.202325 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:47.203083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:47.203820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:48.623810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f6b251c3-322d-4608-b917-197b3a533620 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Action: 'create', calling method: .version_select at 0x7fa33b6c0a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1986528191", "metadata": {"Type": "work"}}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f6b251c3-322d-4608-b917-197b3a533620 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Request method failure captured: Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 122 Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuoXJT7eaIuNf9ol_HTEJBix4NqYnbM8GZirmAzJY6tU7BksIJSsX0p4P7Sdq0vMTCwznsiKbl9M1gzvITm8ZWyXtfE6RtHCqQg1fdxqQOZs0_6B5-Z4c9bFDQ26jLC1IvfLzJAfyzqf_K6FUWGRXoGceeMyGP4jKYueGAGBmxyH02w Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:18:48.630457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e1082e3330ff43b58852314736751cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e1082e3330ff43b58852314736751cc6"}]}] Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 37446da6d8d24fd99257767814d5f4d9 Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1986528191", "metadata": {"Type": "work"}}} Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: Aug 25 03:18:48.631799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1986528191', 'metadata': {'Type': 'work'}}}} Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise error Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi '#$%' Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:18:48.633441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 03:18:48.635568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 03:18:48.639804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 03:18:48.639804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.639804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f6b251c3-322d-4608-b917-197b3a533620 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:18:48.646958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f6b251c3-322d-4608-b917-197b3a533620 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.455579 Aug 25 03:18:48.647562 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Aug 25 03:18:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1458 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 03:18:48.668366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aa0d4441-df61-4664-bf11-acba42a9df01 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Action: 'create', calling method: .version_select at 0x7fa33b6c0af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-260090982", "metadata": {"Type": "work"}}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aa0d4441-df61-4664-bf11-acba42a9df01 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Request method failure captured: Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 119 Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuoXJT7eaIuNf9ol_HTEJBix4NqYnbM8GZirmAzJY6tU7BksIJSsX0p4P7Sdq0vMTCwznsiKbl9M1gzvITm8ZWyXtfE6RtHCqQg1fdxqQOZs0_6B5-Z4c9bFDQ26jLC1IvfLzJAfyzqf_K6FUWGRXoGceeMyGP4jKYueGAGBmxyH02w Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:18:48.675524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e1082e3330ff43b58852314736751cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e1082e3330ff43b58852314736751cc6"}]}] Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 37446da6d8d24fd99257767814d5f4d9 Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-260090982", "metadata": {"Type": "work"}}} Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: Aug 25 03:18:48.676833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-260090982', 'metadata': {'Type': 'work'}}}} Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise error Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi '0' Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:18:48.677640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 03:18:48.679943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 03:18:48.681055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 03:18:48.681055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.683549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aa0d4441-df61-4664-bf11-acba42a9df01 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:18:48.687267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aa0d4441-df61-4664-bf11-acba42a9df01 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023531 Aug 25 03:18:48.687267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Aug 25 03:18:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:18:48.713447 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cc02764e-85c5-44d2-aa3f-6f5295d3fddd tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Action: 'create', calling method: .version_select at 0x7fa33b57b5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1491070958", "metadata": {"Type": "work"}}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cc02764e-85c5-44d2-aa3f-6f5295d3fddd tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Request method failure captured: Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 119 Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuoXJT7eaIuNf9ol_HTEJBix4NqYnbM8GZirmAzJY6tU7BksIJSsX0p4P7Sdq0vMTCwznsiKbl9M1gzvITm8ZWyXtfE6RtHCqQg1fdxqQOZs0_6B5-Z4c9bFDQ26jLC1IvfLzJAfyzqf_K6FUWGRXoGceeMyGP4jKYueGAGBmxyH02w Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:18:48.726837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e1082e3330ff43b58852314736751cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e1082e3330ff43b58852314736751cc6"}]}] Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 37446da6d8d24fd99257767814d5f4d9 Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1491070958", "metadata": {"Type": "work"}}} Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: Aug 25 03:18:48.728390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1491070958', 'metadata': {'Type': 'work'}}}} Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise error Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi '' Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:18:48.729312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 03:18:48.731244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 03:18:48.732999 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 03:18:48.732999 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:48.733840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cc02764e-85c5-44d2-aa3f-6f5295d3fddd tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:18:48.735214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cc02764e-85c5-44d2-aa3f-6f5295d3fddd tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.043285 Aug 25 03:18:48.741143 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Aug 25 03:18:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:18:48.747156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cfe931f4-1e97-4a47-8119-308e2c1e74e7 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Calling method '.version_select at 0x7fa33b57be50>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:48.949616 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2a97a50b-beb6-4f89-9e5f-6a3e076ab509 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Action: 'create', calling method: .version_select at 0x7fa33b6c2af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-91948549"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:49.551435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-cfe931f4-1e97-4a47-8119-308e2c1e74e7 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] HTTP exception thrown: Volume tempest-invalid-1435756372 could not be found. Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cfe931f4-1e97-4a47-8119-308e2c1e74e7 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Request method failure captured: Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1435756372 HTTP/1.1 Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuoXJT7eaIuNf9ol_HTEJBix4NqYnbM8GZirmAzJY6tU7BksIJSsX0p4P7Sdq0vMTCwznsiKbl9M1gzvITm8ZWyXtfE6RtHCqQg1fdxqQOZs0_6B5-Z4c9bFDQ26jLC1IvfLzJAfyzqf_K6FUWGRXoGceeMyGP4jKYueGAGBmxyH02w Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:18:49.556640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e1082e3330ff43b58852314736751cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e1082e3330ff43b58852314736751cc6"}]}] Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 37446da6d8d24fd99257767814d5f4d9 Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Volume tempest-invalid-1435756372 could not be found. Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'tempest-invalid-1435756372'} Aug 25 03:18:49.558211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1435756372 could not be found. (HTTP 404) (Request-ID: req-8cd488eb-a79e-4f58-ae25-80ec071b4443) Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:49.562113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:18:49.563607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1435756372 could not be found. Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:18:49.564977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1435756372 could not be found. Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1435756372 could not be found. Aug 25 03:18:49.566423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:49.568908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cfe931f4-1e97-4a47-8119-308e2c1e74e7 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Returning 404 to user: Volume tempest-invalid-1435756372 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:18:49.570093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cfe931f4-1e97-4a47-8119-308e2c1e74e7 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1435756372" status: 404 len: 99 microversion: 2.1 time: 0.827792 Aug 25 03:18:49.585211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 4/4] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Aug 25 03:18:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1435756372 => generated 99 bytes in 843 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 03:18:49.590767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6f127b6b-9f67-40cb-b863-ed84444ca2f9 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004361 Aug 25 03:18:49.591280 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 5/5] 10.222.0.58 () {58 vars in 1140 bytes} [Thu Aug 25 03:18:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 03:18:49.604985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4d4f254c-e8e6-4c24-8f46-0d5e498a026d tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007279 Aug 25 03:18:49.608275 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 6/6] 10.222.0.58 () {58 vars in 1137 bytes} [Thu Aug 25 03:18:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 03:18:49.623758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-125461d1-8c29-4da6-83e5-2d9ce29b345d tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Calling method '.version_select at 0x7fa33b52e8b0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:50.030781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-125461d1-8c29-4da6-83e5-2d9ce29b345d tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] HTTP exception thrown: Volume d87175aa-2441-44f4-b893-c6fde10d9330 could not be found. Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-125461d1-8c29-4da6-83e5-2d9ce29b345d tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Request method failure captured: Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: DELETE /compute/v2.1/os-volumes/d87175aa-2441-44f4-b893-c6fde10d9330 HTTP/1.1 Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuoXJT7eaIuNf9ol_HTEJBix4NqYnbM8GZirmAzJY6tU7BksIJSsX0p4P7Sdq0vMTCwznsiKbl9M1gzvITm8ZWyXtfE6RtHCqQg1fdxqQOZs0_6B5-Z4c9bFDQ26jLC1IvfLzJAfyzqf_K6FUWGRXoGceeMyGP4jKYueGAGBmxyH02w Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:18:50.032873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e1082e3330ff43b58852314736751cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e1082e3330ff43b58852314736751cc6"}]}] Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 37446da6d8d24fd99257767814d5f4d9 Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Volume d87175aa-2441-44f4-b893-c6fde10d9330 could not be found. Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'd87175aa-2441-44f4-b893-c6fde10d9330'} Aug 25 03:18:50.034156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d87175aa-2441-44f4-b893-c6fde10d9330 could not be found. (HTTP 404) (Request-ID: req-4bf3b820-5027-4757-88f7-a8209a6696b2) Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:50.039215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:18:50.041422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d87175aa-2441-44f4-b893-c6fde10d9330 could not be found. Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 03:18:50.049636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d87175aa-2441-44f4-b893-c6fde10d9330 could not be found. Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d87175aa-2441-44f4-b893-c6fde10d9330 could not be found. Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-125461d1-8c29-4da6-83e5-2d9ce29b345d tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Returning 404 to user: Volume d87175aa-2441-44f4-b893-c6fde10d9330 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-125461d1-8c29-4da6-83e5-2d9ce29b345d tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/d87175aa-2441-44f4-b893-c6fde10d9330" status: 404 len: 109 microversion: 2.1 time: 0.414867 Aug 25 03:18:50.056924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 7/7] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:18:49 2022] DELETE /compute/v2.1/os-volumes/d87175aa-2441-44f4-b893-c6fde10d9330 => generated 109 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:18:50.057997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-208c4de2-fb83-49f9-b894-88fbaec1eed0 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Calling method '.version_select at 0x7fa33b52e820>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:50.234355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-208c4de2-fb83-49f9-b894-88fbaec1eed0 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] HTTP exception thrown: Volume afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f could not be found. Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-208c4de2-fb83-49f9-b894-88fbaec1eed0 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Request method failure captured: Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/os-volumes/afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f HTTP/1.1 Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuoXJT7eaIuNf9ol_HTEJBix4NqYnbM8GZirmAzJY6tU7BksIJSsX0p4P7Sdq0vMTCwznsiKbl9M1gzvITm8ZWyXtfE6RtHCqQg1fdxqQOZs0_6B5-Z4c9bFDQ26jLC1IvfLzJAfyzqf_K6FUWGRXoGceeMyGP4jKYueGAGBmxyH02w Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:18:50.237030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1082e3330ff43b58852314736751cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e1082e3330ff43b58852314736751cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e1082e3330ff43b58852314736751cc6"}]}] Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: e1082e3330ff43b58852314736751cc6 Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesNegativeTest-1577887802 Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 37446da6d8d24fd99257767814d5f4d9 Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesNegativeTest-1577887802-project Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Volume afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f could not be found. Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f'} Aug 25 03:18:50.238198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f could not be found. (HTTP 404) (Request-ID: req-1be17539-2417-4c07-bcee-3b787e0cea2b) Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:50.239436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:18:50.240259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f could not be found. Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:18:50.241058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f could not be found. Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f could not be found. Aug 25 03:18:50.241849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:18:50.243267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-208c4de2-fb83-49f9-b894-88fbaec1eed0 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] Returning 404 to user: Volume afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:18:50.244278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-208c4de2-fb83-49f9-b894-88fbaec1eed0 tempest-VolumesNegativeTest-1577887802 tempest-VolumesNegativeTest-1577887802-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f" status: 404 len: 109 microversion: 2.1 time: 0.198382 Aug 25 03:18:50.257806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 8/8] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:18:50 2022] GET /compute/v2.1/os-volumes/afe5ed8a-e8eb-4964-a2a8-d75cfc884f4f => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:18:50.448655 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2a97a50b-beb6-4f89-9e5f-6a3e076ab509 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.368536 Aug 25 03:18:50.450319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 1/9] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Aug 25 03:18:47 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3372 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 03:18:50.464905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c7dc21d4-b18b-4046-bdf3-ed0c602b3548 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b57b040>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:50.664957 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c7dc21d4-b18b-4046-bdf3-ed0c602b3548 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7" status: 200 len: 343 microversion: 2.1 time: 0.204251 Aug 25 03:18:50.671322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 9/10] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:18:50 2022] GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:51.680849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-675bff0a-6e84-4857-ae61-90478a165b57 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b59a940>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:51.781910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-675bff0a-6e84-4857-ae61-90478a165b57 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7" status: 200 len: 344 microversion: 2.1 time: 0.106124 Aug 25 03:18:51.782541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 2/11] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:18:51 2022] GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:51.807009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f76fccc3-2f6c-46fe-b28a-d9439991d92b tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Action: 'create', calling method: .version_select at 0x7fa33b52e280>, body: {"snapshot": {"volume_id": "ea360a4b-1211-4839-bd95-60adcd91f4a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-229990615"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:52.700890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2593ebfe-0bf0-449a-846b-66d216d5649b tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33b5b2040>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:52.892462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2593ebfe-0bf0-449a-846b-66d216d5649b tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/6d70d8fb-a7c3-4843-8d9e-3dc76248e9a2" status: 200 len: 350 microversion: 2.1 time: 0.197069 Aug 25 03:18:52.893338 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 3/12] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:18:52 2022] GET /compute/v2.1/os-volumes/6d70d8fb-a7c3-4843-8d9e-3dc76248e9a2 => generated 350 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:53.331558 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f76fccc3-2f6c-46fe-b28a-d9439991d92b tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.533900 Aug 25 03:18:53.333874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 10/13] 10.222.0.58 () {60 vars in 1162 bytes} [Thu Aug 25 03:18:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:53.344508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-52b5c649-775f-46cc-b33f-c888d7d124e0 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b5b2790>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:53.501644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-52b5c649-775f-46cc-b33f-c888d7d124e0 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.161684 Aug 25 03:18:53.502250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 4/14] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:18:53 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:53.518037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8de74b90-fbbe-472c-a2da-cc3e9e6b9256 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b4bf700>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:53.965452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8de74b90-fbbe-472c-a2da-cc3e9e6b9256 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.451476 Aug 25 03:18:53.978326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 11/15] 10.222.0.58 () {58 vars in 1140 bytes} [Thu Aug 25 03:18:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:53.978488 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9d1f7fd8-45e6-4622-8be3-39203c35cc03 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b59aa60>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:54.169875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9d1f7fd8-45e6-4622-8be3-39203c35cc03 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.195825 Aug 25 03:18:54.170944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 5/16] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:18:53 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:55.182445 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4638ca89-b2e8-4a9b-935d-8f23ac0f02e8 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b4c59d0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:55.266148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4638ca89-b2e8-4a9b-935d-8f23ac0f02e8 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.087040 Aug 25 03:18:55.268487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 12/17] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:18:55 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:56.278985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8e479be4-deb2-47b0-bfa9-8eeb09e4bd1f tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b5b2af0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:56.499956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8e479be4-deb2-47b0-bfa9-8eeb09e4bd1f tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.225630 Aug 25 03:18:56.505331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 6/18] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:18:56 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:57.514204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3f1cafaf-34f6-4833-901d-002688b376d3 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b4bf700>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:57.586603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3f1cafaf-34f6-4833-901d-002688b376d3 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.077839 Aug 25 03:18:57.589706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 13/19] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:18:57 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:58.410644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1099016288", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "networks": [{"uuid": "6da8c58d-fbee-41e4-9c1d-ee06344077d1"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:58.601316 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f3f4ee15-8275-4913-bde1-dd1d9d80b04c tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b4bf040>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:58.646616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f3f4ee15-8275-4913-bde1-dd1d9d80b04c tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.049075 Aug 25 03:18:58.646904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 14/20] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:18:58 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:18:58.679978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] validate_networks() for [('6da8c58d-fbee-41e4-9c1d-ee06344077d1', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:18:59.662259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-32437d96-21d2-4ab6-a0ab-a71a36dc675f tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b52eaf0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:59.703341 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-32437d96-21d2-4ab6-a0ab-a71a36dc675f tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.048733 Aug 25 03:18:59.704850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 15/21] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:18:59 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:19:00.718329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-80454853-8e0d-40da-a666-163d031075d0 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b52ec10>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:00.843060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-80454853-8e0d-40da-a666-163d031075d0 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 287 microversion: 2.1 time: 0.129910 Aug 25 03:19:00.844132 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 16/22] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:19:00 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:19:00.880814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c60c14ae-db65-4005-b717-2c377e82ef42 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b52eaf0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:01.098046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c60c14ae-db65-4005-b717-2c377e82ef42 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 202 len: 0 microversion: 2.1 time: 0.244904 Aug 25 03:19:01.098633 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 17/23] 10.222.0.58 () {58 vars in 1254 bytes} [Thu Aug 25 03:19:00 2022] DELETE /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:19:01.115268 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-33f13e63-4f83-4387-8b66-27b2bd6df958 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33b4bff70>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:01.175739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-33f13e63-4f83-4387-8b66-27b2bd6df958 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 200 len: 286 microversion: 2.1 time: 0.067391 Aug 25 03:19:01.176723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 18/24] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:19:01 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:01.709411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:19:01.710915 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:19:01.711542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:19:01.712058 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:19:01.712576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:19:01.747134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:01.750595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:01.756381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:01.761721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:01.761721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:01.761721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:01.813028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Getting quotas for project a5e956906b484196945c8deb97beaf5d. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:19:01.829803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Getting quotas for user 827bfe2d861146b3aa67cfe147dc16d3 and project a5e956906b484196945c8deb97beaf5d. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:19:01.844790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:19:01.848856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:19:02.093757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f7103722-5e3c-4af4-b423-c42a8a5a410d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.081498 Aug 25 03:19:02.095011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 7/25] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:19:02.115248 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d28e1c27-30e0-45a9-8157-3b9d2ccfb65b tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ac42550>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:02.120807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-993262993", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:02.331841 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d28e1c27-30e0-45a9-8157-3b9d2ccfb65b tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b3677d0e-985a-4688-bcec-592bb0bb7018" status: 200 len: 351 microversion: 2.1 time: 0.233837 Aug 25 03:19:02.342790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 8/26] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:19:02 2022] GET /compute/v2.1/os-volumes/b3677d0e-985a-4688-bcec-592bb0bb7018 => generated 351 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:02.347600 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0c125d5d-7534-43d5-b7db-e0a3d593605b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:02.348257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0c125d5d-7534-43d5-b7db-e0a3d593605b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:02.362660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] validate_networks() for [('1fdf63ec-44a0-4852-85a8-eedf09ade4f7', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:19:02.765132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0c125d5d-7534-43d5-b7db-e0a3d593605b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:02.827293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0c125d5d-7534-43d5-b7db-e0a3d593605b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1215 microversion: 2.1 time: 0.473966 Aug 25 03:19:02.827293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 9/27] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:02 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:02.848357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a896c00b-5265-4e17-846f-4ce64c3c4d28 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33ac4e9d0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:02.901989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-a896c00b-5265-4e17-846f-4ce64c3c4d28 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] HTTP exception thrown: Snapshot dc04565b-2113-45a6-9bc3-25779952ecdf could not be found. Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a896c00b-5265-4e17-846f-4ce64c3c4d28 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Request method failure captured: Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf HTTP/1.1 Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuoXneFTaPqiuuTQdN41UZTxKTPAAUFX7ndtQrxgfRqgU_qIxZCRMqF_wMVOs0E-liRbbJFAvGN0cRLD6E6N_82z_H7EvUPTa_ht_h0vvaafnXfCPsP2eJ2RVvmh1sUZYrrYEuamf5YfWAP11sLMElzIZ3bQELM6LteUVY6lwLhR1co Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:19:02.908613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4754b68abd046f68f0f422c90a583f5"}]}] Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 680dbbbc2e9249cb865ddc540461ac28 Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Snapshot dc04565b-2113-45a6-9bc3-25779952ecdf could not be found. Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'dc04565b-2113-45a6-9bc3-25779952ecdf'} Aug 25 03:19:02.910080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dc04565b-2113-45a6-9bc3-25779952ecdf could not be found. (HTTP 404) (Request-ID: req-a4903bfa-4d9f-4566-a460-b60c19d118c5) Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:02.911009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:19:02.912906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dc04565b-2113-45a6-9bc3-25779952ecdf could not be found. Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 25 03:19:02.915059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dc04565b-2113-45a6-9bc3-25779952ecdf could not be found. Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dc04565b-2113-45a6-9bc3-25779952ecdf could not be found. Aug 25 03:19:02.917475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:02.919840 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a896c00b-5265-4e17-846f-4ce64c3c4d28 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Returning 404 to user: Snapshot dc04565b-2113-45a6-9bc3-25779952ecdf could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:19:02.920837 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a896c00b-5265-4e17-846f-4ce64c3c4d28 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf" status: 404 len: 111 microversion: 2.1 time: 0.096146 Aug 25 03:19:02.922269 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 10/28] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 25 03:19:02 2022] GET /compute/v2.1/os-snapshots/dc04565b-2113-45a6-9bc3-25779952ecdf => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:19:03.476496 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4e6f0b2e-47da-4c0c-a337-443f1903c9fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'create', calling method: .version_select at 0x7fa33ac68ca0>, body: {"keypair": {"name": "tempest-keypair-2010202725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGN1GvGh66GPbEuJ6DXtXVGSZhnmouOgH45vFFmLndSCij/nW3WD0eaqOoL5LgNnnszEnBOKHgi5lMmh+lPKdXqspxmBZ8RyTUbbMF7Wb1fCnLQ08DJPotPJCI4vByjgjw=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:03.518114 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-4e6f0b2e-47da-4c0c-a337-443f1903c9fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:19:03.522580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-4e6f0b2e-47da-4c0c-a337-443f1903c9fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for user 83e90afadb164c82bc93c47099c14460 and project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:19:03.760480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4e6f0b2e-47da-4c0c-a337-443f1903c9fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.833494 Aug 25 03:19:03.760480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 11/29] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:19:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:03.765299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ecdd9415-df78-454a-9b3c-f99ca13fe588 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33abcf1f0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:04.068409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ecdd9415-df78-454a-9b3c-f99ca13fe588 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7" status: 202 len: 0 microversion: 2.1 time: 0.307577 Aug 25 03:19:04.069320 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 12/30] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:19:03 2022] DELETE /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:19:04.079242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9e24855a-7bab-4ff0-ba0c-d9c8dabfb502 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:04.079879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9e24855a-7bab-4ff0-ba0c-d9c8dabfb502 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:04.317876 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9e24855a-7bab-4ff0-ba0c-d9c8dabfb502 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:04.332394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9e24855a-7bab-4ff0-ba0c-d9c8dabfb502 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1215 microversion: 2.1 time: 0.261315 Aug 25 03:19:04.336417 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 13/31] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:04 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:04.361795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4888682b-4d03-4c2b-957e-7f909c330845 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33abcfb80>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:04.540606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4888682b-4d03-4c2b-957e-7f909c330845 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7" status: 200 len: 343 microversion: 2.1 time: 0.202130 Aug 25 03:19:04.541368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 14/32] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:19:04 2022] GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:04.844285 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:19:04.844797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:19:04.845170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:19:04.845602 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:19:04.846008 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:19:04.884634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:04.885144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:04.893425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:04.894442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:04.894923 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:04.895684 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:04.977497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for project d0928e519ec247b988a254d7918cbfed. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:19:04.995561 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for user c7dc5019b26a4a8abf6436be3f1e56af and project d0928e519ec247b988a254d7918cbfed. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:19:05.064496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:19:05.077287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:19:05.341631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5470ddbf-3ed9-4cd0-a3de-c52334200f7c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.107683 Aug 25 03:19:05.342370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 19/33] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:19:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 4110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:19:05.355443 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7efb00d2-0341-4521-ac69-fdf0b27a366a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:05.361113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7efb00d2-0341-4521-ac69-fdf0b27a366a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:05.362081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:05.369603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:05.399815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:05.400625 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:05.401219 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:05.402651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:05.403956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:05.404572 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:05.813172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7efb00d2-0341-4521-ac69-fdf0b27a366a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:05.820528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7efb00d2-0341-4521-ac69-fdf0b27a366a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1221 microversion: 2.1 time: 0.470165 Aug 25 03:19:05.823007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 15/34] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:05 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1221 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:05.842905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8c25b9cb-bda4-4d7a-971b-f0e2e88c3d2c tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33abcfa60>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:05.879578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:05.898127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-8c25b9cb-bda4-4d7a-971b-f0e2e88c3d2c tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] HTTP exception thrown: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8c25b9cb-bda4-4d7a-971b-f0e2e88c3d2c tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Request method failure captured: Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 HTTP/1.1 Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuoXneFTaPqiuuTQdN41UZTxKTPAAUFX7ndtQrxgfRqgU_qIxZCRMqF_wMVOs0E-liRbbJFAvGN0cRLD6E6N_82z_H7EvUPTa_ht_h0vvaafnXfCPsP2eJ2RVvmh1sUZYrrYEuamf5YfWAP11sLMElzIZ3bQELM6LteUVY6lwLhR1co Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:19:05.901767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4754b68abd046f68f0f422c90a583f5"}]}] Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 680dbbbc2e9249cb865ddc540461ac28 Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'ea360a4b-1211-4839-bd95-60adcd91f4a7'} Aug 25 03:19:05.902879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. (HTTP 404) (Request-ID: req-60b2a8c3-1eab-48f4-950a-cbfe99cc2643) Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:05.904120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:19:05.905209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:19:05.906126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8c25b9cb-bda4-4d7a-971b-f0e2e88c3d2c tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Returning 404 to user: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:19:05.907109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8c25b9cb-bda4-4d7a-971b-f0e2e88c3d2c tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7" status: 404 len: 109 microversion: 2.1 time: 0.081593 Aug 25 03:19:05.914982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 16/35] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:19:05 2022] GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:19:05.925924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-129ffd69-c5ba-4cba-8517-047e74901d25 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ab79280>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:05.927261 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fda35f22-5c3b-4664-a6c3-e49ea3157745 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1219 microversion: 2.1 time: 0.569183 Aug 25 03:19:05.948021 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 20/36] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:05 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1219 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:05.963801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2dedfb35-fb8d-451e-ae17-7c70c2dc2d36 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33ab4b790>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:06.082403 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-129ffd69-c5ba-4cba-8517-047e74901d25 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4b44ed3b-1758-4424-8554-bf1ea77f8fda" status: 200 len: 350 microversion: 2.1 time: 0.165953 Aug 25 03:19:06.083381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 17/37] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:19:05 2022] GET /compute/v2.1/os-volumes/4b44ed3b-1758-4424-8554-bf1ea77f8fda => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:06.114710 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-afea9ac4-fa4d-42f9-8bad-290486c1b9ec tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ac6c8b0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:06.164797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-2dedfb35-fb8d-451e-ae17-7c70c2dc2d36 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] HTTP exception thrown: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2dedfb35-fb8d-451e-ae17-7c70c2dc2d36 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Request method failure captured: Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: DELETE /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 HTTP/1.1 Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuoXneFTaPqiuuTQdN41UZTxKTPAAUFX7ndtQrxgfRqgU_qIxZCRMqF_wMVOs0E-liRbbJFAvGN0cRLD6E6N_82z_H7EvUPTa_ht_h0vvaafnXfCPsP2eJ2RVvmh1sUZYrrYEuamf5YfWAP11sLMElzIZ3bQELM6LteUVY6lwLhR1co Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:19:06.166987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4754b68abd046f68f0f422c90a583f5"}]}] Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 680dbbbc2e9249cb865ddc540461ac28 Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'ea360a4b-1211-4839-bd95-60adcd91f4a7'} Aug 25 03:19:06.168298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. (HTTP 404) (Request-ID: req-16fe465e-4de5-4329-91d4-29ad71954deb) Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:06.169630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:19:06.175279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 03:19:06.177943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2dedfb35-fb8d-451e-ae17-7c70c2dc2d36 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Returning 404 to user: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2dedfb35-fb8d-451e-ae17-7c70c2dc2d36 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7" status: 404 len: 109 microversion: 2.1 time: 0.217095 Aug 25 03:19:06.180071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 21/38] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:19:05 2022] DELETE /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:19:06.189569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-772610897", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:06.281290 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] validate_networks() for [('1fdf63ec-44a0-4852-85a8-eedf09ade4f7', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:19:06.376526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-afea9ac4-fa4d-42f9-8bad-290486c1b9ec tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.282722 Aug 25 03:19:06.377570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 18/39] 10.222.0.58 () {58 vars in 1134 bytes} [Thu Aug 25 03:19:06 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:06.382444 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d278fd87-847e-46b3-8734-8a9602fe7c72 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Calling method '.version_select at 0x7fa33ab79550>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:06.956220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-d278fd87-847e-46b3-8734-8a9602fe7c72 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] HTTP exception thrown: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d278fd87-847e-46b3-8734-8a9602fe7c72 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Request method failure captured: Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 HTTP/1.1 Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuoXneFTaPqiuuTQdN41UZTxKTPAAUFX7ndtQrxgfRqgU_qIxZCRMqF_wMVOs0E-liRbbJFAvGN0cRLD6E6N_82z_H7EvUPTa_ht_h0vvaafnXfCPsP2eJ2RVvmh1sUZYrrYEuamf5YfWAP11sLMElzIZ3bQELM6LteUVY6lwLhR1co Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:19:06.958327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a4754b68abd046f68f0f422c90a583f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a4754b68abd046f68f0f422c90a583f5"}]}] Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a4754b68abd046f68f0f422c90a583f5 Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-828873559 Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 680dbbbc2e9249cb865ddc540461ac28 Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-828873559-project Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'ea360a4b-1211-4839-bd95-60adcd91f4a7'} Aug 25 03:19:06.959653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. (HTTP 404) (Request-ID: req-a1ef44d5-7c0e-4535-a0cb-f8ca5d324093) Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:06.960576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:19:06.961614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:19:06.962537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. Aug 25 03:19:06.964597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:19:06.968373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d278fd87-847e-46b3-8734-8a9602fe7c72 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] Returning 404 to user: Volume ea360a4b-1211-4839-bd95-60adcd91f4a7 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:19:06.969428 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d278fd87-847e-46b3-8734-8a9602fe7c72 tempest-VolumesSnapshotsTestJSON-828873559 tempest-VolumesSnapshotsTestJSON-828873559-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7" status: 404 len: 109 microversion: 2.1 time: 0.590872 Aug 25 03:19:06.970247 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 19/40] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:19:06 2022] GET /compute/v2.1/os-volumes/ea360a4b-1211-4839-bd95-60adcd91f4a7 => generated 109 bytes in 592 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:19:06.985896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c5bdfca5-c1c3-4526-8411-9237c6323912 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33abcf0d0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:07.265634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c5bdfca5-c1c3-4526-8411-9237c6323912 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.289933 Aug 25 03:19:07.270368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 20/41] 10.222.0.58 () {58 vars in 1149 bytes} [Thu Aug 25 03:19:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:07.272217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:07.274704 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:07.296743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:07.298749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:07.299370 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:07.300556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:07.301164 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:07.309007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:07.894938 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:19:07.895504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:19:07.896057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:19:07.896542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:19:07.897776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:19:07.915291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:07.915428 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:07.916263 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:07.917495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:07.921051 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:07.922162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:07.923651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:07.948115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ff588e7d-673e-4e09-a95e-48121a9dbb80 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1275 microversion: 2.1 time: 0.677348 Aug 25 03:19:07.950792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 21/42] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:07 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1275 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:07.973941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d7f9b0a7-6bf8-45a6-8fb7-101b73fc4e03 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ab790d0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:07.978963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for project d0928e519ec247b988a254d7918cbfed. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:19:07.995405 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for user c7dc5019b26a4a8abf6436be3f1e56af and project d0928e519ec247b988a254d7918cbfed. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:19:08.024672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:19:08.036749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:19:08.251588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d7f9b0a7-6bf8-45a6-8fb7-101b73fc4e03 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.283729 Aug 25 03:19:08.257204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 22/43] 10.222.0.58 () {58 vars in 1134 bytes} [Thu Aug 25 03:19:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:08.267027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cdec1b53-763d-4468-9fcb-b8584c897156 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.095963 Aug 25 03:19:08.267678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:19:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:19:08.277616 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6c088718-4b4a-49c6-b94a-75f9e55edcf9 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ab21820>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:08.283882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3bb46357-cbcc-4756-b1a8-5a4a3dc8d7e2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:08.285064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3bb46357-cbcc-4756-b1a8-5a4a3dc8d7e2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:08.415420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3bb46357-cbcc-4756-b1a8-5a4a3dc8d7e2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:08.437925 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3bb46357-cbcc-4756-b1a8-5a4a3dc8d7e2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1221 microversion: 2.1 time: 0.159081 Aug 25 03:19:08.439074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 23/45] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:08 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:08.500136 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6c088718-4b4a-49c6-b94a-75f9e55edcf9 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.234059 Aug 25 03:19:08.501267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 23/46] 10.222.0.58 () {58 vars in 1167 bytes} [Thu Aug 25 03:19:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:08.520774 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8478db3f-05a6-41ea-9905-f581a1625c5b tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ab724c0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:08.760958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8478db3f-05a6-41ea-9905-f581a1625c5b tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.249505 Aug 25 03:19:08.770485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 24/47] 10.222.0.58 () {58 vars in 1170 bytes} [Thu Aug 25 03:19:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:08.777322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a552af0d-b8fe-4141-a8bd-91602093d73f tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ab21ca0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:08.951322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a552af0d-b8fe-4141-a8bd-91602093d73f tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.178869 Aug 25 03:19:08.960321 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 24/48] 10.222.0.58 () {58 vars in 1155 bytes} [Thu Aug 25 03:19:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:08.967265 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-de3b7d11-5f1e-4582-80fe-90fb9f806194 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ab723a0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:08.984828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:08.988145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:09.028127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:09.028636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:09.034056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:09.034966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:09.044683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:09.045301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:09.156021 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:09.170980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6351ea8a-359b-4b08-b71c-18a6f59b0aeb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1273 microversion: 2.1 time: 0.192606 Aug 25 03:19:09.173521 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 25/49] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:08 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:09.237808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-de3b7d11-5f1e-4582-80fe-90fb9f806194 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.276690 Aug 25 03:19:09.240786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 25/50] 10.222.0.58 () {58 vars in 1188 bytes} [Thu Aug 25 03:19:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:09.253941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e942df36-6d99-47b9-ab7c-a80497e8f020 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] Calling method '.version_select at 0x7fa33ab0c5e0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:09.460483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-464bae42-4e8c-4bec-b7bf-fb31b98c0d64 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:09.461155 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-464bae42-4e8c-4bec-b7bf-fb31b98c0d64 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:09.557413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e942df36-6d99-47b9-ab7c-a80497e8f020 tempest-VolumesTestJSON-614226969 tempest-VolumesTestJSON-614226969-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.308158 Aug 25 03:19:09.558250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 26/51] 10.222.0.58 () {58 vars in 1155 bytes} [Thu Aug 25 03:19:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:09.641926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-464bae42-4e8c-4bec-b7bf-fb31b98c0d64 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:09.651266 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-464bae42-4e8c-4bec-b7bf-fb31b98c0d64 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1221 microversion: 2.1 time: 0.195259 Aug 25 03:19:09.654798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 26/52] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:09 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1221 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:09.703204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1439142672", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d61a031-2546-4f6b-af01-1710648e9256"}], "security_groups": [{"name": "tempest-securitygroup--546230765"}], "key_name": "tempest-keypair-2010202725", "user_data": "}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:10.203870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:10.206270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:10.256401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:10.258583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:10.261284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:10.283415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:10.284392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:10.292784 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:10.417956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] validate_networks() for [('5d61a031-2546-4f6b-af01-1710648e9256', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:19:10.651377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:10.668101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-63177b1c-2fe6-4e4a-9317-05825e2230ab tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1273 microversion: 2.1 time: 0.473084 Aug 25 03:19:10.670877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 27/53] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:10 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1273 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:10.697382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:10.699649 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:10.712442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:10.713282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:10.713941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:10.714933 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:10.716874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:10.717531 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:11.169878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:11.180843 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b5ebd41c-6592-4cab-8d06-f955ea3d820a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1217 microversion: 2.1 time: 0.491504 Aug 25 03:19:11.202556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 28/54] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:10 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1217 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:11.693507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:11.694863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:11.706960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:11.708690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:11.710852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:11.712086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:11.713218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:11.714788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:11.790956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:11.976387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:19:11.976806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:19:11.977281 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:19:11.977687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:19:11.978094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:19:11.994637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:11.995914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:11.996537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:11.998213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:11.998935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:11.999554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:12.021049 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:19:12.028576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for user 83e90afadb164c82bc93c47099c14460 and project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:19:12.048593 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:19:12.051790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:19:12.067809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:12.077457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6702996b-af33-4c68-9ed6-58e2056e00bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.389425 Aug 25 03:19:12.081669 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 29/55] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:11 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:12.165947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2d70e8b6-fcf2-40ba-a383-1f1f0dc9fb4c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.476680 Aug 25 03:19:12.172775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 27/56] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:19:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:19:12.179760 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5a0ab277-af5c-43b2-8a22-50ad8b83897b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:12.180711 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5a0ab277-af5c-43b2-8a22-50ad8b83897b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:12.223268 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:12.223891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:12.232439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:12.233216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:12.234012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:12.235033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:12.235867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:12.236499 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:12.254656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5a0ab277-af5c-43b2-8a22-50ad8b83897b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:12.263732 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5a0ab277-af5c-43b2-8a22-50ad8b83897b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1238 microversion: 2.1 time: 0.088057 Aug 25 03:19:12.275109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 30/57] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:12 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:12.306483 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:12.315469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9e2be29f-18e5-4238-8982-261e1395b5fc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.096729 Aug 25 03:19:12.316048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 28/58] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:12 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:13.100197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:13.101812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:13.109655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.111146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.111866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.112833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.113568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.114208 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.287531 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:13.293880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-af5eae75-a89f-4436-8bf7-1d93f9d87f45 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:13.296176 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-af5eae75-a89f-4436-8bf7-1d93f9d87f45 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:13.301375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b9fc215f-eda0-4d86-87d1-f2eae7cc0cf1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.204995 Aug 25 03:19:13.314715 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 31/59] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:13 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:13.341839 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:13.342694 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:13.383493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.384282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.384827 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.391151 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.393763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.394530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.423509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-af5eae75-a89f-4436-8bf7-1d93f9d87f45 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:13.431296 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-af5eae75-a89f-4436-8bf7-1d93f9d87f45 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1238 microversion: 2.1 time: 0.148967 Aug 25 03:19:13.436803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 29/60] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:13 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:13.550601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:13.560616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ad3992fa-9e5e-479a-ad45-68ec6695dae5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.224789 Aug 25 03:19:13.561556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 32/61] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:13 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:14.322044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:14.322726 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:14.330595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.331083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.331516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:14.332213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.332663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.333083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:14.458320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:14.459018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:14.467091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.472901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.473564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:14.479130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.479767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.480714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:14.503192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:14.511327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2c412914-84bf-448b-89d4-68a1df5f78a8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.193110 Aug 25 03:19:14.511902 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 30/62] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:14 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:14.569381 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:14.580101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-15205560-82ce-4a9c-982f-2ee17481a2fa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.125534 Aug 25 03:19:14.581234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 33/63] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:14 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:14.593582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:14.594323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:14.602247 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.603726 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.604178 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:14.604955 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.605411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.605944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:14.711339 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:14.719557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-df15ab5e-8dfa-437f-ac53-551a5c28ee74 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.132812 Aug 25 03:19:14.720238 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:14 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:15.534004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:15.534743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:15.542247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:15.543352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:15.544383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:15.551803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:15.552293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:15.552732 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:15.610381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:15.616225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:15.637354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:15.637854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:15.638458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:15.639421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:15.640228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:15.640853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:15.724413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:15.742504 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9c24be0b-3750-4234-af5e-5873ad09a9ed tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.131546 Aug 25 03:19:15.743175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 32/65] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:15 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:15.748734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:15.749348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:15.755202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:15.755682 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:15.756293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:15.757115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:15.757423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:15.757849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:15.759739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:15.767256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-74620d2a-6c40-417b-b342-673855c2a5f2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.237043 Aug 25 03:19:15.767829 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 34/66] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:15 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:15.859289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:15.893809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-122ba31e-26b2-4f30-a01d-32a53c91def6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.148823 Aug 25 03:19:15.894750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 33/67] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:15 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:16.764306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:16.765058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:16.772035 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.772516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.773027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.773719 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.774167 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.774618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.790667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:16.791909 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:16.798073 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.798591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.799024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.799725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.800173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.800587 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.843047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:16.851392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-780b2c3e-3c51-4e18-9b40-5d73e2baea91 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.091437 Aug 25 03:19:16.852153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 35/68] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:16 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:16.915146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:16.915756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:16.921803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.922331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.922750 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.923446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.923896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.924779 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.942853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:16.954795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7132ac2a-9908-4bfe-8c0f-cad76ee9414d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.167747 Aug 25 03:19:16.956032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:16 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:17.011270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:17.019894 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c3e2258b-e08e-4387-8895-0e888f4e5f31 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.108737 Aug 25 03:19:17.020465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 36/70] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:16 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:17.872088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:17.872749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:17.878808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:17.881814 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:17.881814 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:17.881814 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:17.881814 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:17.882172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:17.962887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:17.971874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2e0f0fee-019a-450c-ad80-f914e63cf855 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.103593 Aug 25 03:19:17.972518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 35/71] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:17 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:17.977613 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:17.979500 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:17.981991 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=4 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:17.990127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:17.992198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:17.992888 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:17.998467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:17.999396 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:18.000335 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:18.044615 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:18.045430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:18.056211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:18.057625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:18.059143 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:18.068047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:18.068047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:18.068047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:18.173147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:18.181665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c2d79c35-7cb7-463e-98bf-2ed933240e48 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.142720 Aug 25 03:19:18.182240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 36/72] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:18 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:18.211906 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:18.222269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cca0b2ad-1471-4b8b-ac47-c88e55b6d94b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.249480 Aug 25 03:19:18.223032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 37/73] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:17 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:18.992188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:18.992865 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:18.999032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:18.999564 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:18.999993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.000674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:19.001290 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:19.001719 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.064053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:19.072069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dfc43676-ea8c-4668-b79a-dd676e6d515f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.083850 Aug 25 03:19:19.072638 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 37/74] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:18 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:19.203497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:19.204916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:19.227101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:19.227648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:19.228351 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.229068 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:19.229522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:19.229995 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.244177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:19.244794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:19.251621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:19.252107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:19.252714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.254040 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:19.254538 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:19.254969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.300450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:19.308128 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-29c03c9e-917f-42f0-ba57-0761c3b3e014 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.108707 Aug 25 03:19:19.308709 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 38/75] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:19 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:19.399279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:19.407904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-74f355f2-075a-411f-9b1d-8882671c0c0f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.167534 Aug 25 03:19:19.408771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 38/76] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:19 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:20.094534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:20.095165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:20.101467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.102176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.108168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:20.108168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.108168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.108168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:20.191540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:20.208107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-dfb61e1a-a1b4-4bc6-964d-516fd8bbf138 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.110368 Aug 25 03:19:20.208107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 39/77] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:20 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:20.330571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:20.331739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:20.338101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.338619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.339050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:20.339780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.340228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.340648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:20.412664 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:20.440057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:20.440057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:20.440250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1f84653b-308f-4e83-9e6e-4c00b42d1068 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.107708 Aug 25 03:19:20.440250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 39/78] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:20 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:20.440394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.440865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.441305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:20.442164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.442642 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.443071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:20.575576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:20.584135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c15382e4-5318-4149-a198-23d024c0f7b1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.155197 Aug 25 03:19:20.584716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 40/79] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:20 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:21.222849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:21.223429 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:21.229494 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:21.229946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:21.230411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:21.231111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:21.231691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:21.232121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:21.295025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:21.303241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-271810d6-66b3-4365-9bb4-f50e66f8e702 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.086373 Aug 25 03:19:21.303805 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 40/80] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:21 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:21.460040 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:21.460636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:21.469060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:21.469547 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:21.469980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:21.470702 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:21.471158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:21.471585 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:21.533296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:21.540862 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aea6b8dd-2f59-4eb2-842a-dbb1f0091123 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.085702 Aug 25 03:19:21.541423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 41/81] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:21 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:21.604338 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:21.604979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:21.610917 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:21.611391 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:21.611826 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:21.612505 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:21.612951 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:21.613368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:21.754500 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:21.762813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-51ac1f7b-95b5-4858-afa6-85c443a147e8 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.162180 Aug 25 03:19:21.763748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 41/82] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:21 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:22.323873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:22.324498 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:22.330768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=18 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:22.332909 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.333512 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.334853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.334853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.335183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.335635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.411117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:22.414941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:22.420824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-97d4516e-f011-4f7f-90f7-dbcbadcefa93 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.100540 Aug 25 03:19:22.427097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 42/83] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:22 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:22.561687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:22.562331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:22.568495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:22.582367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.582367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.582367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.582367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.582807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.582807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.646348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:22.653193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:22.656130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-27396e3d-2cd3-4dd1-9493-b350dc510bed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.098850 Aug 25 03:19:22.658416 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 42/84] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:22 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:22.790542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:22.791107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:22.798222 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.798797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.799231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.800007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.800468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.800889 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.955738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:22.964494 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ef31ebd9-9755-4236-a651-55bb1cc5715a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.178269 Aug 25 03:19:22.965245 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 43/85] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:22 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:23.444904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:23.452604 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:23.452604 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=24 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:23.452882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.453368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.453801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:23.454543 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.454979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.455401 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:23.523882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:23.533300 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9de3466f-f1ab-4703-9cad-48abad41292c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.092069 Aug 25 03:19:23.533873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 43/86] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:23 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:23.678937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:23.679797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:23.686796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.691497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.691497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:23.691497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.691497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.691872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:23.774345 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:23.781917 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8491c34d-423f-416a-9ee8-d8fbf9fe8011 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.107113 Aug 25 03:19:23.782563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 44/87] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:23 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:23.985752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:23.986443 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:23.992626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.993140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.993569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:23.994291 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.994810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.997824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:24.128202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:24.135853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5a402522-9882-4eed-8935-d0dcce50a165 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.154567 Aug 25 03:19:24.136422 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 44/88] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:23 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:24.553785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:24.554426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:24.560285 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:24.560760 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:24.561188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:24.561870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:24.562344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:24.562768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:24.624549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:24.632073 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-061a83a6-46b4-4337-a515-aab750078cbf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.082108 Aug 25 03:19:24.632642 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 45/89] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:24 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:24.802729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:24.803333 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:24.806507 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:24.810020 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:24.810537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:24.811022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:24.811702 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:24.812152 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:24.812613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:24.873921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:24.881664 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0e8fe264-a8a2-4ebf-8d6b-59ba0620737b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.082874 Aug 25 03:19:24.882242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 45/90] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:24 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:25.156454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:25.157059 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:25.162997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.163481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.163915 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:25.164596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.165047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.165507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:25.379872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:25.390216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-87bc695c-0962-4815-8c0b-7712af09a8dc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.237614 Aug 25 03:19:25.390928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 46/91] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:25 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:25.655368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:25.658272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:25.663147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.663626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.665096 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:25.665809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.666308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.667155 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:25.766583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:25.776405 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-628cd02d-e1fc-401e-a30c-a8246a0701a6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.126011 Aug 25 03:19:25.776997 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 46/92] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:25 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:25.903124 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:25.904494 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:25.911784 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.912366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.912876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:25.913652 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.914175 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.915314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:26.008284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:26.016635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-dbeae012-676c-4af4-9d31-892e5f777a2e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.117530 Aug 25 03:19:26.017287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 47/93] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:25 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:26.411058 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:26.411669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:26.417646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:26.418125 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:26.418603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:26.419294 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:26.419746 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:26.420172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:26.546986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:26.554528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-74454a4f-4e1f-4ad1-a5d8-f37835242eb1 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.147633 Aug 25 03:19:26.555102 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 47/94] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:26 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:26.801289 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:26.802016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:26.807731 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:26.808206 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:26.808661 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:26.809305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:26.809753 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:26.810170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:26.872590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:26.881130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cfe2d7ed-97a3-4250-ae68-0b2967db18f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.083545 Aug 25 03:19:26.881700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 48/95] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:26 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:27.038032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:27.038608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:27.044631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:27.045131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:27.046139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:27.046863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:27.047310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:27.047725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:27.112620 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:27.120028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fd519789-612e-4fbc-9d8a-e129e1c7e1dd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.085842 Aug 25 03:19:27.120595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 48/96] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:27 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:27.575525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:27.576131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:27.578077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:27.582788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:27.588951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:27.588951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:27.588951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:27.588951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:27.589304 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:27.712423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:27.719952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-39352b97-04e3-443b-aa18-9ed76a8bbe57 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.148558 Aug 25 03:19:27.720519 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 49/97] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:27 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:27.900841 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:27.901449 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:27.908012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:27.908497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:27.908928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:27.909637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:27.910069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:27.910533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:27.970682 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:27.978120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-86697b4d-db68-464d-9657-d2183bc53d6d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.081153 Aug 25 03:19:27.978729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 49/98] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:27 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:28.141232 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:28.141768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:28.147991 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:28.151743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:28.151743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:28.151743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:28.151743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:28.152102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:28.212974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:28.220987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4ddbde22-be4e-43ec-b57f-227b9971282e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.083850 Aug 25 03:19:28.221556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 50/99] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:28 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:28.741063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:28.741667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:28.747624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:28.748126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:28.749079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:28.749777 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:28.750254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:28.750709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:28.875221 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:28.882904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c6f67d69-d5af-4b4f-8b3e-2239ad4c161e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.145863 Aug 25 03:19:28.883471 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 50/100] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:28 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:29.001429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:29.002362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:29.008954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:29.009584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:29.010009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:29.010739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:29.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:29.011726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:29.075092 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:29.082747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ec52beee-d529-44c0-ac94-65ad2a98930d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.087466 Aug 25 03:19:29.083328 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 51/101] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:28 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:29.242252 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:29.242967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:29.249538 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:29.250010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:29.250473 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:29.251157 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:29.251612 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:29.252046 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:29.317497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:29.325657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6074a22e-665b-4fb0-b8cd-f7a253e0f214 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.087234 Aug 25 03:19:29.326180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 51/102] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:29 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:29.904543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:29.905235 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:29.911354 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:29.911831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:29.912260 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:29.912955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:29.913401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:29.913820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.053605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:30.062488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c647f751-ee5d-42b5-a34c-832b6bdb8742 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.161367 Aug 25 03:19:30.063069 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 52/103] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:29 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:30.103042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:30.103714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:30.110909 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.111452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.111938 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.112706 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.113191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.113708 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.175252 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:30.184141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2ec90139-f637-4d9f-a2c1-bcda201d63f6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1242 microversion: 2.1 time: 0.084956 Aug 25 03:19:30.190215 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 52/104] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:30 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:30.348147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:30.348773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:30.355463 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.356134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.360279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.360279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.360279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.360279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.434472 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:30.441944 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d0c64b5d-450c-4948-ba4c-a3578b9ec8ec tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1273 microversion: 2.1 time: 0.098824 Aug 25 03:19:30.442545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 53/105] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:30 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:30.774598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-5aba5c8c-8580-45d2-bad9-1ab0c8ebe05f req-3f3f7567-3672-40c3-a4b4-7351ce5b4169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccfd9dce-16ff-4644-a35d-aadaad1fb6e0", "tag": "6617e5b0-8d38-402d-9b29-b384949c1c60"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:30.781755 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5aba5c8c-8580-45d2-bad9-1ab0c8ebe05f req-3f3f7567-3672-40c3-a4b4-7351ce5b4169 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.782356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5aba5c8c-8580-45d2-bad9-1ab0c8ebe05f req-3f3f7567-3672-40c3-a4b4-7351ce5b4169 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.782790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5aba5c8c-8580-45d2-bad9-1ab0c8ebe05f req-3f3f7567-3672-40c3-a4b4-7351ce5b4169 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.786053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-456ff0a3-7396-4915-bacb-2b88d80b131d req-017956bd-0949-48a1-a414-5317273ce1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43663cc7-978f-486b-806b-ffaf5e6f19d4", "tag": "b798688d-53a9-4934-8eaa-792032011dc8"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:30.798291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-456ff0a3-7396-4915-bacb-2b88d80b131d req-017956bd-0949-48a1-a414-5317273ce1e6 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.803371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-456ff0a3-7396-4915-bacb-2b88d80b131d req-017956bd-0949-48a1-a414-5317273ce1e6 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.803371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-456ff0a3-7396-4915-bacb-2b88d80b131d req-017956bd-0949-48a1-a414-5317273ce1e6 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.803592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-5aba5c8c-8580-45d2-bad9-1ab0c8ebe05f req-3f3f7567-3672-40c3-a4b4-7351ce5b4169 service nova] Creating event network-changed:6617e5b0-8d38-402d-9b29-b384949c1c60 for instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 on hv-cinder-85164 Aug 25 03:19:30.803592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5aba5c8c-8580-45d2-bad9-1ab0c8ebe05f req-3f3f7567-3672-40c3-a4b4-7351ce5b4169 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 03:19:30.803592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-5aba5c8c-8580-45d2-bad9-1ab0c8ebe05f req-3f3f7567-3672-40c3-a4b4-7351ce5b4169 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 03:19:30.803592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.804040 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.804466 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.805176 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.805627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.806048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.814944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.compute.rpcapi [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 03:19:30.815822 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] Releasing lock "compute-rpcapi-router" {{(pid=121277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 03:19:30.818304 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-456ff0a3-7396-4915-bacb-2b88d80b131d req-017956bd-0949-48a1-a414-5317273ce1e6 service nova] Creating event network-changed:b798688d-53a9-4934-8eaa-792032011dc8 for instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 on hv-cinder-85164 Aug 25 03:19:30.818827 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-456ff0a3-7396-4915-bacb-2b88d80b131d req-017956bd-0949-48a1-a414-5317273ce1e6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 03:19:30.819211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-456ff0a3-7396-4915-bacb-2b88d80b131d req-017956bd-0949-48a1-a414-5317273ce1e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 03:19:30.820305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.820766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.821189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.821899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:30.822366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:30.822961 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:30.832262 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.compute.rpcapi [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 03:19:30.832676 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ee828392-3658-43a7-9cc3-9f4aaa80a893 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128098 Aug 25 03:19:30.833147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] Releasing lock "compute-rpcapi-router" {{(pid=121278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 03:19:30.833678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 53/106] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:30.848348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-49be4509-131d-4fb4-9f06-2bd2777323f2 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120860 Aug 25 03:19:30.848947 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 54/107] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:19:31.085212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:31.086012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:31.092617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:31.093178 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:31.093934 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:31.094762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:31.095274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:31.096205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:31.210781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:31.211604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:31.217778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:31.218361 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:31.218866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:31.219649 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:31.220172 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:31.220670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:31.225362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:31.233005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6c3678f6-b604-4c63-bfe9-a8b4844efe60 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.152328 Aug 25 03:19:31.233570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 54/108] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:31 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:31.289360 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:31.297508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8e2b3463-8158-427b-9057-0279f4f8c135 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1234 microversion: 2.1 time: 0.090968 Aug 25 03:19:31.298088 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 55/109] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:31 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:31.463014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:31.463676 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:31.469628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:31.470115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:31.470585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:31.471280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:31.471730 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:31.472162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:31.531851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:31.539357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-563d93c1-646d-43b7-887e-a30fb1128c89 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1281 microversion: 2.1 time: 0.080187 Aug 25 03:19:31.539940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 55/110] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:31 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:32.254113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:32.254749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:32.261009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:32.261622 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:32.262061 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:32.262796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:32.263248 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:32.263669 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:32.319733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:32.321240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:32.331388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:32.331977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:32.332419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:32.333111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:32.333566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:32.333993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:32.404677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:32.410475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-025c2a37-968f-43d7-95f0-05f99c283f3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1234 microversion: 2.1 time: 0.095198 Aug 25 03:19:32.411384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 56/111] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:32 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1234 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:32.416945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:32.424612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3d5fbb9a-6e8e-4d94-a335-424fd58d28d4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.174348 Aug 25 03:19:32.425176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 56/112] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:32 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:32.560735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:32.561344 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:32.568099 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:32.568606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:32.569036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:32.569714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:32.570163 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:32.570613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:32.635158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:32.642784 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d076fd3e-ca11-45a9-a2a6-4f4c6a4dbcb6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1281 microversion: 2.1 time: 0.085915 Aug 25 03:19:32.643354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 57/113] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:32 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:33.431094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:33.431636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:33.437556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:33.438025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:33.438504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:33.439185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:33.439712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:33.440137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:33.444701 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:33.445301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:33.451419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:33.451893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:33.452327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:33.453494 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:33.453946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:33.454394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:33.501393 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:33.509079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-946abccb-7c2c-4758-92df-312b5a04cc13 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1234 microversion: 2.1 time: 0.081879 Aug 25 03:19:33.509666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 57/114] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:33 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1234 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:33.599041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:33.606614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c4b1edf8-a810-4251-9f1a-cee11b386832 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.165655 Aug 25 03:19:33.607176 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 58/115] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:33 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:33.663107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:33.663707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:33.669564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:33.670036 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:33.670499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:33.671172 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:33.671615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:33.672024 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:33.734039 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:33.741589 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6fce5b87-307c-4fd5-9dc7-908c8c10e4df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1281 microversion: 2.1 time: 0.082286 Aug 25 03:19:33.742166 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 58/116] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:33 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:34.529856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:34.530419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:34.536525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:34.537001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:34.537444 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:34.538127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:34.538614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:34.539041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:34.599256 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:34.602749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:34.607405 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-248ac36a-f5cb-421b-b390-4f8f3a9d9a11 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1234 microversion: 2.1 time: 0.081433 Aug 25 03:19:34.607972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 59/117] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:34 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1234 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:34.628766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:34.629373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:34.635487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:34.635963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:34.636394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:34.637075 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:34.637572 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:34.637934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:34.762348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:34.763074 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:34.767979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:34.769876 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:34.770574 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:34.771013 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:34.772204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:34.772312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:34.772415 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:34.772608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:34.777959 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d7e598bf-d4a9-48a6-8cbc-b04efbdd4b87 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.152208 Aug 25 03:19:34.777959 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 59/118] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:34 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:34.834494 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:34.842321 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-03817f8a-ec6d-4e62-ae1e-461ce347a558 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1281 microversion: 2.1 time: 0.083717 Aug 25 03:19:34.843560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 60/119] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:34 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:35.629467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:35.636010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:35.644417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:35.644911 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:35.645523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:35.646223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:35.647052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:35.647509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:35.728892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:35.737305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c15b2a13-5c95-4f72-82a1-da4bc271496a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1290 microversion: 2.1 time: 0.112530 Aug 25 03:19:35.737904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 60/120] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:35 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1290 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:35.808965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:35.811051 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:35.827062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:35.829311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:35.830153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:35.831109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:35.831739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:35.832805 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:35.863475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:35.865605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:35.876599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:35.879247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:35.879751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:35.880426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:35.880887 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:35.881336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:36.421256 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:36.440348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ab0930e5-6298-4c91-8818-135f546f24a4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.644155 Aug 25 03:19:36.447549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:36.452462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 61/121] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:35 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:36.471635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c2c8b0b0-b833-492c-965c-9f1b66a434ea tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.606734 Aug 25 03:19:36.479518 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 61/122] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:35 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:36.765428 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:36.766042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:36.778301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:36.779461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:36.780105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:36.781126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:36.781788 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:36.782881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:36.850845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:36.858314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dac3c563-3141-46eb-9734-791dabbd75f8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.104234 Aug 25 03:19:36.859087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 62/123] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:36 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:37.432768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-31331b5a-27d1-4894-98c1-2e3e9e3ca5ac req-97a2b5b0-85bf-4d7c-a904-95da2258c94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51885fa-4bf2-4ac7-83f2-f2602026abef", "tag": "21f33b3d-4de9-4a8d-a91d-ba726d282ce6"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:37.446345 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-31331b5a-27d1-4894-98c1-2e3e9e3ca5ac req-97a2b5b0-85bf-4d7c-a904-95da2258c94d service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:37.446781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-31331b5a-27d1-4894-98c1-2e3e9e3ca5ac req-97a2b5b0-85bf-4d7c-a904-95da2258c94d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:37.447197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-31331b5a-27d1-4894-98c1-2e3e9e3ca5ac req-97a2b5b0-85bf-4d7c-a904-95da2258c94d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:37.465070 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:37.465690 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:37.472495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:37.472978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:37.475293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-31331b5a-27d1-4894-98c1-2e3e9e3ca5ac req-97a2b5b0-85bf-4d7c-a904-95da2258c94d service nova] Creating event network-changed:21f33b3d-4de9-4a8d-a91d-ba726d282ce6 for instance e51885fa-4bf2-4ac7-83f2-f2602026abef on hv-cinder-85164 Aug 25 03:19:37.478680 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:37.479398 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:37.479856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:37.480331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:37.486274 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-31331b5a-27d1-4894-98c1-2e3e9e3ca5ac req-97a2b5b0-85bf-4d7c-a904-95da2258c94d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059254 Aug 25 03:19:37.487091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 62/124] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:37.497431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:37.498321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:37.507756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:37.508581 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:37.509352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:37.510579 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:37.511249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:37.511682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:37.691384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:37.718543 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-83972383-6ddd-421d-a475-066e48d911cb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.238375 Aug 25 03:19:37.718543 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 63/125] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:37 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:37.719063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:37.728200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5fda4ae1-30fc-4811-99c5-4e151ac2e606 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.234787 Aug 25 03:19:37.730521 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 63/126] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:37 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:37.879491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:37.880962 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:37.887744 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:37.888468 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:37.888964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:37.889776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:37.890310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:37.890956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:37.993602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:38.006657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1f377d13-e34b-4965-b6f6-88387f444439 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.130919 Aug 25 03:19:38.007710 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 64/127] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:37 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:38.731210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:38.731814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:38.738240 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:38.738766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:38.739176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:38.739855 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:38.740356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:38.740781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:38.748764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:38.749413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:38.755939 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:38.756413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:38.756866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:38.757764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:38.758222 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:38.758674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:39.000470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:39.004431 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:39.010965 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-00621e68-768d-4aa2-8e35-122d3ceebaec tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.283583 Aug 25 03:19:39.014403 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c2d27016-4a49-4a93-8829-43e4935fa7bb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.269296 Aug 25 03:19:39.014994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 65/128] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:38 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:39.023656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 64/129] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:38 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:39.034668 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:39.034940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:39.041404 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:39.042059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:39.042689 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:39.043548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:39.044176 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:39.044776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:39.113522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:39.121302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0fbf4117-bf6e-461f-a9ca-c5814a68de8e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.091831 Aug 25 03:19:39.121872 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 66/130] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:39 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:40.036232 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:40.037002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:40.037288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:40.037918 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:40.045586 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:40.046189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:40.047319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:40.048884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:40.049569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:40.050063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:40.051806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:40.052279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:40.052722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:40.053431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:40.053888 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:40.054329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:40.254156 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:40.269024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c2bc5cad-93a7-443f-bced-e59dad82de6a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.237981 Aug 25 03:19:40.269628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 67/131] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:40 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:40.278872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:40.285525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:40.287570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:40.299438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7997e9d8-c49e-477e-b62c-047c5ff7e2d0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.260756 Aug 25 03:19:40.299438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 65/132] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:40 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:40.300054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:40.300054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:40.300054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:40.300054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:40.300736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:40.300736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:40.365278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:40.373238 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-adba960f-d782-492e-bafc-271096720128 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.102174 Aug 25 03:19:40.373828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 68/133] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:40 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:41.292004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:41.292552 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:41.294611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:41.302605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:41.303295 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:41.303908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:41.305286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:41.305286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:41.305578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:41.314956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:41.315674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:41.321400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:41.323658 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:41.324623 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:41.325293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:41.326337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:41.327007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:41.327621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:41.514712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:41.523517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:41.523655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b2751814-45cd-44ca-b827-8175c14196bb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.236167 Aug 25 03:19:41.523655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 66/134] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:41 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:41.527423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:41.528026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:41.530436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fc50626a-c8a1-430a-9e6c-476d675d507c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.221072 Aug 25 03:19:41.531005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 69/135] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:41 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:41.534395 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:41.535077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:41.535515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:41.536200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:41.536797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:41.537223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:41.598877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:41.606519 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4a86bdfe-a6b1-4941-8927-bcdae2a45499 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.082542 Aug 25 03:19:41.607095 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 67/136] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:41 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:42.543602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:42.544207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:42.551084 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:42.551405 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:42.551806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:42.551966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:42.552060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:42.552651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:42.553101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:42.553521 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:42.558648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:42.559132 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:42.559560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:42.560445 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:42.560898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:42.561312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:42.763388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:42.767464 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:42.771228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-40b1c206-a10b-455c-a640-fccbd7b9576b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.231395 Aug 25 03:19:42.771813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 70/137] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:42 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:42.775287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b1ca445b-bc51-4e07-afc4-6db0b923efb8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.228081 Aug 25 03:19:42.775854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 68/138] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:42 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:42.776439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:42.777044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:42.783049 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:42.783557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:42.784011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:42.784697 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:42.785143 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:42.785561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:42.854789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:42.864893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-491d8a68-6a8e-4adf-81eb-2dd89bdec6b2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.092042 Aug 25 03:19:42.866631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 71/139] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:42 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:43.795882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:43.796486 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:43.797520 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:43.798412 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:43.802579 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:43.803272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:43.803692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:43.804377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:43.804984 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:43.805402 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:43.806042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:43.806553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:43.806976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:43.807660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:43.808104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:43.808515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:44.017191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:44.020848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:44.032820 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-05f097ad-027d-4656-b195-8a9324370bf3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.240043 Aug 25 03:19:44.034804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 72/140] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:43 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:44.037698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-07cfdec9-7133-4a2d-89d7-ef49a89d07ce tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.245577 Aug 25 03:19:44.039085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:44.040462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:44.046824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:44.047498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:44.048598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:44.049491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:44.050126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:44.050743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:44.053372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 69/141] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:43 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:44.124867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:44.133033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8dfc4192-da22-40c1-8053-9ef56b74d9bc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.098007 Aug 25 03:19:44.133608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 73/142] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:44 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:45.059477 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:45.059961 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:45.060312 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:45.060454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:45.066722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:45.066868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:45.067128 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:45.067251 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:45.067559 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:45.067656 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:45.068266 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:45.068371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:45.068692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:45.068811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:45.069108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:45.069204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:45.392812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:45.403100 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b50ccf2-1176-4fc6-9e35-89ce89791f44 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.347236 Aug 25 03:19:45.404003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 74/143] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:45 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:45.406610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:45.411258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:45.412412 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:45.415432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ce28db60-af0b-4e97-9811-20c138995ff3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.359762 Aug 25 03:19:45.421359 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 70/144] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:45 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:45.422171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:45.423442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:45.423964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:45.424683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:45.425144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:45.425560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:45.531111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:45.543765 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0ec5644a-25b0-4583-95d1-3ab2c6f2b97a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1296 microversion: 2.1 time: 0.137059 Aug 25 03:19:45.557914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 75/145] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:45 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1296 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:46.423135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:46.423857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:46.430404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:46.430961 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:46.431486 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:46.432247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:46.432766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:46.433283 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:46.441880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:46.442530 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:46.448680 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:46.449587 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:46.450510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:46.451369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:46.451969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:46.452542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:46.473190 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:46.656034 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:46.657216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:46.665333 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-513a3179-4703-4c62-9055-632cf72a76bf tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.228231 Aug 25 03:19:46.666237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 76/146] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:46 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:46.670754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:46.671363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:46.677386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:46.678028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:46.678632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:46.679575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:46.680191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:46.680761 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:46.683697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8d1a3174-50e4-418a-b662-07b56399994c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.247106 Aug 25 03:19:46.684687 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 71/147] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:46 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:46.825462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:46.835883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-90cd0033-d94a-459e-9906-e95a1a2dd7c1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.168528 Aug 25 03:19:46.836854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 77/148] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:46 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:47.690535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:47.691134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:47.697376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:47.697780 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:47.698393 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:47.699510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:47.700102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:47.700516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:47.706685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:47.707867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:47.714105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:47.714778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:47.715359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:47.716228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:47.716817 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:47.717385 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:47.906027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:47.910527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-38fa539e-c4c2-4008-9006-54029a46e20f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.223934 Aug 25 03:19:47.911105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 72/149] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:47 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:47.929209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:47.929988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:47.936718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:47.937260 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:47.938084 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:47.939047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:47.939700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:47.940333 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:47.966156 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:47.975061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-28e6bfba-1937-4622-b1ee-6cafe1b7ddd0 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.272855 Aug 25 03:19:47.982981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 78/150] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:47 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:48.131322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:48.134503 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7db6ac60-219e-4598-bed9-f0b2d53f39f1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.209381 Aug 25 03:19:48.135091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 73/151] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:47 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:48.934066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:48.934699 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:48.940544 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:48.946082 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:48.946082 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:48.946082 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:48.946082 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:48.946414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:49.003144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:49.003690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:49.009564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:49.015195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:49.015195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:49.015195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:49.015195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:49.015545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:49.122084 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:49.131355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1bac7ed8-61bc-4316-b080-174726375ed0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.201823 Aug 25 03:19:49.132089 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 79/152] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:48 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:49.157681 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:49.159219 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:49.165606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:49.166086 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:49.166685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:49.167672 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:49.168272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:49.168818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:49.170368 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:49.179001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0177c657-3ec7-453c-9d37-a9b327e7543d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.179784 Aug 25 03:19:49.179583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 74/153] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:48 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:49.305439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:49.314092 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-df7a654a-cf7e-4956-8e3d-68ace2182307 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.160647 Aug 25 03:19:49.314915 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 80/154] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:49 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:50.159537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:50.160330 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:50.166634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:50.167515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:50.167638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:50.168428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:50.169056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:50.169552 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:50.201209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:50.201814 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:50.207835 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:50.208325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:50.208753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:50.209441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:50.209893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:50.210335 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:50.392199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:50.400616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-47d7ea79-d8f1-451a-869c-c2af7a3733af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.244933 Aug 25 03:19:50.414320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 75/155] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:50 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:50.414512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:50.414610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:50.414610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:50.414764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9fbdb12a-a7c7-4cf1-90db-9a99254cca5e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.216295 Aug 25 03:19:50.414764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 81/156] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:50 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:50.433717 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:50.434214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:50.434703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:50.435404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:50.435843 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:50.437197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:50.574217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:50.583471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e1ad1664-e11e-433d-b8e7-e3583d277c04 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.180764 Aug 25 03:19:50.584055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 76/157] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:50 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:51.421033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:51.421804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:51.433596 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:51.434507 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:51.434880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:51.436085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:51.436689 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:51.437261 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:51.439964 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:51.440529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:51.451495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:51.451990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:51.452423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:51.455221 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:51.456895 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:51.459502 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:51.471787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:51.664877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:51.672986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d131f00a-c9a3-44c0-a4dd-c77309fdb5a1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.255596 Aug 25 03:19:51.673557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 82/158] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:51 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:51.674316 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:51.678393 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:51.678886 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:51.682416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a30c4936-4b38-4eaa-9a38-e90fe70d0b46 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.246536 Aug 25 03:19:51.683432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 77/159] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:51 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:51.686400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:51.686990 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:51.690524 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:51.690524 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:51.690524 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:51.690524 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:51.821459 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:51.829373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7a6d9727-4b62-4c2b-aa80-26a1d62de6ae tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.154697 Aug 25 03:19:51.830631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 83/160] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:51 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:52.716756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:52.716756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:52.717346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:52.717346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:52.718611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:52.719098 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:52.719526 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:52.722614 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:52.724538 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:52.725270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:52.726512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:52.728795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:52.731341 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:52.731791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:52.732218 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:52.736834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:53.578532 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:53.588585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-941e69d0-5f5e-47c9-a5a1-9717f3ba9ff4 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.885409 Aug 25 03:19:53.589819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 84/161] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:52 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:53.592360 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:53.595454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:53.596253 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:53.601900 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-43267d77-c686-46d2-bb02-bd46ec3cbbef tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.901430 Aug 25 03:19:53.604510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 78/162] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:52 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:53.625153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:53.625834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:53.627426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:53.628353 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:53.630055 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:53.631199 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:53.765147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-9b2fba37-3555-47a1-8d32-8666abe3cd77 req-5a385ef9-2fc0-4dd3-a46a-008a0d6f0d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43663cc7-978f-486b-806b-ffaf5e6f19d4", "name": "network-vif-plugged", "status": "completed", "tag": "b798688d-53a9-4934-8eaa-792032011dc8"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:53.781012 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9b2fba37-3555-47a1-8d32-8666abe3cd77 req-5a385ef9-2fc0-4dd3-a46a-008a0d6f0d8d service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:53.781752 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9b2fba37-3555-47a1-8d32-8666abe3cd77 req-5a385ef9-2fc0-4dd3-a46a-008a0d6f0d8d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:53.782253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9b2fba37-3555-47a1-8d32-8666abe3cd77 req-5a385ef9-2fc0-4dd3-a46a-008a0d6f0d8d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:53.795355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-9b2fba37-3555-47a1-8d32-8666abe3cd77 req-5a385ef9-2fc0-4dd3-a46a-008a0d6f0d8d service nova] Creating event network-vif-plugged:b798688d-53a9-4934-8eaa-792032011dc8 for instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 on hv-cinder-85164 Aug 25 03:19:53.807347 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-9b2fba37-3555-47a1-8d32-8666abe3cd77 req-5a385ef9-2fc0-4dd3-a46a-008a0d6f0d8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199945 Aug 25 03:19:53.808357 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 79/163] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:53.840253 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:53.847993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b93de681-6a71-4b57-81e3-76c7fee92243 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.257047 Aug 25 03:19:53.848559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 85/164] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:53 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:54.228976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-7954fd00-34ec-4e16-b83e-99aff4333273 req-8086c26b-058f-45a0-bd12-82a8f09930eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89", "tag": "2633e92d-506e-4aa5-964a-5eee157a0a48"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:54.239691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7954fd00-34ec-4e16-b83e-99aff4333273 req-8086c26b-058f-45a0-bd12-82a8f09930eb service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:54.240188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7954fd00-34ec-4e16-b83e-99aff4333273 req-8086c26b-058f-45a0-bd12-82a8f09930eb service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:54.240913 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7954fd00-34ec-4e16-b83e-99aff4333273 req-8086c26b-058f-45a0-bd12-82a8f09930eb service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:54.253181 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-7954fd00-34ec-4e16-b83e-99aff4333273 req-8086c26b-058f-45a0-bd12-82a8f09930eb service nova] Creating event network-changed:2633e92d-506e-4aa5-964a-5eee157a0a48 for instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 on hv-cinder-85164 Aug 25 03:19:54.257872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-7954fd00-34ec-4e16-b83e-99aff4333273 req-8086c26b-058f-45a0-bd12-82a8f09930eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032851 Aug 25 03:19:54.258503 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 80/165] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:54.615520 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:54.616410 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:54.624250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:54.625102 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:54.625684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:54.627137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:54.627776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:54.628347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:54.628631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:54.629656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:54.637257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:54.637738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:54.638258 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:54.639983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:54.640543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:54.641055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:54.841483 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:54.852648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-05261313-6f3e-4cbb-a5e3-b8c8cebafb65 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.242929 Aug 25 03:19:54.858080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:54.860489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 86/166] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:54 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:54.873346 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-131b3218-00d3-46af-b845-9bf554f274df tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.248721 Aug 25 03:19:54.874191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 81/167] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:54 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:54.879029 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:54.883142 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:54.891399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:54.892189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:54.892662 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:54.893364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:54.893813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:54.894232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:55.045766 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:55.054139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-41aaaa66-d7e8-4908-91b5-f41ceda2c735 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.187476 Aug 25 03:19:55.054734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 87/168] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:54 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:55.911319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:55.911319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:55.911319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:55.911319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:55.912002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:55.912002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:55.912002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:55.912002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:55.912283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:55.912283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:55.912283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:55.912283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:55.912800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:55.912800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:55.912800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:55.912800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:56.074855 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:56.083666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-72c9c1b1-d405-4109-8759-a76ecec88c1c tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.212836 Aug 25 03:19:56.084546 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 82/169] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:55 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:56.091450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:56.092423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:56.102788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:56.103271 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:56.103702 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:56.104412 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:56.104850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:56.105315 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:56.107987 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:56.117267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d6c8c49b-a13c-4b73-ad9f-6f1a5711c2a0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.223305 Aug 25 03:19:56.117990 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 88/170] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:55 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:56.250399 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:56.266089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7b7a3549-1691-453a-8e27-2c0b6ece3b1a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.179896 Aug 25 03:19:56.267197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 83/171] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:56 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:57.104806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:57.105348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:57.107238 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=87 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:57.111914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:57.112401 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:57.112834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:57.113527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:57.113972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:57.114423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:57.139080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:57.139777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:57.146706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:57.147184 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:57.147766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:57.148619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:57.149065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:57.149484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:57.306497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:57.316328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-52816d51-721f-4065-bbe2-b1c9d4a15b08 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.215444 Aug 25 03:19:57.316992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 89/172] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:57 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:57.322076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:57.322721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:57.334052 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:57.336429 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:57.336429 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:57.336628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:57.336975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:57.337678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:57.348692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:57.359672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ad4bdb7d-7b08-4a48-b38b-a2e430a5d303 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.224365 Aug 25 03:19:57.360252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 84/173] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:57 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:57.490982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:57.508400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ffe8d773-70aa-4dd1-b490-cc0941d18b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.190246 Aug 25 03:19:57.518380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 90/174] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:57 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:58.337219 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:58.338025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:58.341011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=72 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:58.344590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.345958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.346423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.347308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.347912 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.348344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.381904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:58.383260 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:58.394105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.394613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.399763 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.400504 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.401045 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.401470 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.546634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:58.558998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4986c27e-4474-43c5-adab-c1ea5f61f01d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.225533 Aug 25 03:19:58.560453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 85/175] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:58 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:58.565619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:58.566432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:58.573023 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.573505 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.574182 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.574914 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.575364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.575789 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.640372 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:58.648773 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-834dca4a-dee2-4715-803e-a8baf56f5918 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.272838 Aug 25 03:19:58.649347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 91/176] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:58 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:58.724121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:58.731679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f1e33441-e8ae-417c-814f-62fb2f888656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.170266 Aug 25 03:19:58.732253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 86/177] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:58 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:59.589627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:59.590855 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:59.597377 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.597875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.598332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:59.600704 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.600704 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.600704 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:59.668749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:59.669444 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:59.676282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.676757 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.677331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:59.678024 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.678666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.679083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:59.824957 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:59.833052 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9d1c0b25-e2ff-4b7f-be19-d491d2d773d7 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.249287 Aug 25 03:19:59.833731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 92/178] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:59 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:59.838236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:59.838863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:59.851833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.851833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.851833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:59.851833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.852325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.852325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:59.854574 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:59.904149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:59.913562 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9587b404-2d2e-4ecb-a162-7a0005a4c3dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.248577 Aug 25 03:19:59.914557 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 87/179] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:59 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:00.035126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:00.042740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ab7a5362-7275-4c69-8ef2-6dff56520ad0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.208030 Aug 25 03:20:00.043314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 93/180] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:59 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:00.853724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:00.855248 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:00.860922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:00.861414 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:00.861852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:00.862673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:00.863028 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:00.863449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:00.935086 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:00.936285 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:00.948564 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:00.952660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:00.952660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:00.953359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:00.954183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:00.955669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:01.081041 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:01.091780 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9c6dab43-0ee6-475d-a704-87114611644a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.241748 Aug 25 03:20:01.093239 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 88/181] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:00 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:01.106371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:01.107272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:01.114418 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:01.115378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:01.116344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:01.117528 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:01.119256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:01.120454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:01.139463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:01.158887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f72ef02f-5b46-48a5-8694-763ba2e68bc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.227739 Aug 25 03:20:01.176147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 94/182] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:00 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:01.209600 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-4b4bb2d6-eb2c-48ab-9cb1-68a221b9788e req-45af8273-4bc8-4414-b560-f71ff0515f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccfd9dce-16ff-4644-a35d-aadaad1fb6e0", "name": "network-vif-plugged", "status": "completed", "tag": "6617e5b0-8d38-402d-9b29-b384949c1c60"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:01.221215 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b4bb2d6-eb2c-48ab-9cb1-68a221b9788e req-45af8273-4bc8-4414-b560-f71ff0515f28 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:01.221691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b4bb2d6-eb2c-48ab-9cb1-68a221b9788e req-45af8273-4bc8-4414-b560-f71ff0515f28 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:01.222305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b4bb2d6-eb2c-48ab-9cb1-68a221b9788e req-45af8273-4bc8-4414-b560-f71ff0515f28 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:01.233563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-4b4bb2d6-eb2c-48ab-9cb1-68a221b9788e req-45af8273-4bc8-4414-b560-f71ff0515f28 service nova] Creating event network-vif-plugged:6617e5b0-8d38-402d-9b29-b384949c1c60 for instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 on hv-cinder-85164 Aug 25 03:20:01.238757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-4b4bb2d6-eb2c-48ab-9cb1-68a221b9788e req-45af8273-4bc8-4414-b560-f71ff0515f28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040744 Aug 25 03:20:01.239553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 95/183] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:01.276131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:01.284391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6446ee67-3526-46ce-8112-0b11e07b0e42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.189916 Aug 25 03:20:01.284954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 89/184] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:01 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:02.115935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:02.116626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:02.122749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.123223 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.123651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.124327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.124880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.125204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.183389 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:02.183929 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:02.191223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.191733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.192164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.192856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.193511 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.194046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.359268 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:02.367752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5bd706b9-59c2-473f-b13d-fba4296ae60e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.256747 Aug 25 03:20:02.368330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 96/185] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:02 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:02.372914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:02.373513 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:02.379187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.379666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.380098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.381071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.381528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.381981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.417166 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:02.425764 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cac61eb4-e356-4d70-9164-6a323f233cc5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.249460 Aug 25 03:20:02.426370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 90/186] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:02 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:02.551383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:02.559194 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-76be5c43-227e-4a64-8cdb-7809d7675ebb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.189845 Aug 25 03:20:02.559866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 97/187] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:02 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:03.388953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:03.389561 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:03.396265 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.396737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.397165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.397846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.398318 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.398734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.446139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:03.446882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:03.455631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.456474 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.456994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.457764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.458309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.458812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.577993 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:03.593097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ee1a6b39-5436-4e34-af7b-76ac5a58990f tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.207853 Aug 25 03:20:03.593697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 91/188] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:03 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:03.599061 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:03.599882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:03.608743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.611314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.611810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.612522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.612970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.613579 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.646005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:03.658645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-feaf3036-01d4-41df-a2b4-1d2cd242b92b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.211473 Aug 25 03:20:03.658645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 98/189] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:03 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:03.754679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:03.762342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f5ccc5fa-33e4-45e0-be85-4384491d1664 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.167322 Aug 25 03:20:03.762911 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 92/190] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:03 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:04.617757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:04.618466 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:04.624667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.625217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.625651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:04.626370 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.626825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.627250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:04.676513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:04.678138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:04.688325 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.689325 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.690093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:04.690996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.691592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.692507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:04.905854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:04.914343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e77b68e4-856a-4a86-8458-8cdce9b705ea tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.300415 Aug 25 03:20:04.915138 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 99/191] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:04 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:04.919641 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:04.920295 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:04.928751 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.929234 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.929664 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:04.930381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.930829 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.931278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:05.327103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:05.335778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-871473f2-6355-44f9-8e25-307033218be6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.664911 Aug 25 03:20:05.336344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 93/192] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:04 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:05.370229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:05.384788 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cbc48519-8ba7-4585-9d6f-655403017e3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.462211 Aug 25 03:20:05.384788 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 100/193] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:04 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:05.935713 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:05.936473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:05.943071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:05.943638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:05.943964 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:05.944653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:05.945797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:05.946759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.080674 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:06.088200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f16307f6-3edd-491a-95a2-e276880c101e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.156372 Aug 25 03:20:06.088769 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 94/194] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:05 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:06.356753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:06.357887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:06.364553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:06.365033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:06.365469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.366158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:06.366638 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:06.377012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.401001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:06.401604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:06.408136 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:06.408602 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:06.409030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.409802 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:06.410255 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:06.410699 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.415738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:06.547932 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:06.556295 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-39f743d0-baa6-48ac-9c76-0ef5f55d47ad tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.203813 Aug 25 03:20:06.556891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 101/195] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:06 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:06.576355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:06.585614 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-10bb5e88-23c1-413b-bd22-8156b69acf4e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.188382 Aug 25 03:20:06.586199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 95/196] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:06 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:07.108831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:07.109448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:07.117996 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.118515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.119185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.119963 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.120403 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.121016 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.281122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:07.303569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b65d42b0-c20a-430d-a888-6faa17cfbcbb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.186447 Aug 25 03:20:07.306887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 102/197] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:07 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:07.312941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-f0ff461f-648b-495a-94c5-7f6307cb6447 req-106a978a-ba90-431b-a5fd-0dc5e861aa27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51885fa-4bf2-4ac7-83f2-f2602026abef", "name": "network-vif-plugged", "status": "completed", "tag": "21f33b3d-4de9-4a8d-a91d-ba726d282ce6"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:07.323213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f0ff461f-648b-495a-94c5-7f6307cb6447 req-106a978a-ba90-431b-a5fd-0dc5e861aa27 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.323688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f0ff461f-648b-495a-94c5-7f6307cb6447 req-106a978a-ba90-431b-a5fd-0dc5e861aa27 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.324368 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f0ff461f-648b-495a-94c5-7f6307cb6447 req-106a978a-ba90-431b-a5fd-0dc5e861aa27 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.340473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-f0ff461f-648b-495a-94c5-7f6307cb6447 req-106a978a-ba90-431b-a5fd-0dc5e861aa27 service nova] Creating event network-vif-plugged:21f33b3d-4de9-4a8d-a91d-ba726d282ce6 for instance e51885fa-4bf2-4ac7-83f2-f2602026abef on hv-cinder-85164 Aug 25 03:20:07.346229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-f0ff461f-648b-495a-94c5-7f6307cb6447 req-106a978a-ba90-431b-a5fd-0dc5e861aa27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036610 Aug 25 03:20:07.347003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 96/198] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:07.578797 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:07.579489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:07.588420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.589013 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.589520 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.590315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.590848 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.591382 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.608843 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:07.611329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:07.619040 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.619696 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.622233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.622233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.622233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.622233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.803094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:07.811965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d3f6099a-cd9b-4115-864f-5e4ac365eacd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.238955 Aug 25 03:20:07.812557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 103/199] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:07 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:07.816063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:07.824773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-659b8902-dcb1-48af-9a35-84029b24fb43 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.220690 Aug 25 03:20:07.825289 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 97/200] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:07 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:07.958252 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1757417185", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "networks": [{"uuid": "ca0143b6-0a6e-48e5-b8f9-c9884ef057e9"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:08.019411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] validate_networks() for [('ca0143b6-0a6e-48e5-b8f9-c9884ef057e9', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:20:08.312009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:08.312611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:08.319306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.319882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.320188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:08.320873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.321319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.321736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:08.415156 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:20:08.415782 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:20:08.416302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:20:08.416666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:20:08.417994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:20:08.431458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.431946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.432378 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:08.433103 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.433555 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.433978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:08.453919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Getting quotas for project 882db843d4644ac29365868d1deb9a27. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:20:08.458828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Getting quotas for user 2552825edca0418392f877ea9488e36f and project 882db843d4644ac29365868d1deb9a27. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:20:08.470094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:20:08.473075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:20:08.483041 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:08.491532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2bbfeb21-7f11-4dfc-9bac-b991997141cd tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.183346 Aug 25 03:20:08.492116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 98/201] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:08 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:08.643888 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2d79b918-b208-4d84-a89a-f902e0358774 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690373 Aug 25 03:20:08.644536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 104/202] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:20:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:20:08.655177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2eecee2e-93a5-46bb-86ed-34c54096501e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:08.656062 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2eecee2e-93a5-46bb-86ed-34c54096501e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:08.735047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2eecee2e-93a5-46bb-86ed-34c54096501e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:08.749312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2eecee2e-93a5-46bb-86ed-34c54096501e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1214 microversion: 2.1 time: 0.097793 Aug 25 03:20:08.750627 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 99/203] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:08 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:08.846726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:08.847829 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:08.848452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:08.854818 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:08.855215 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.856471 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.857150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:08.858257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.858995 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.859575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:08.867865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.869431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.869865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:08.871758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:08.872752 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:08.873168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:09.134379 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:09.142880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-745ddccc-bc33-46c4-969f-7755e9c41ee7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.308683 Aug 25 03:20:09.143546 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 105/204] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:08 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:09.148926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:09.156651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-59e89629-d8b7-4cdd-a7d3-010d573412c5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.315475 Aug 25 03:20:09.157231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 100/205] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:08 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:09.512247 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:09.512858 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:09.519419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:09.519920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:09.520347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:09.521046 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:09.521497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:09.521919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:09.710146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:09.725733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b25b7b31-7dc7-4fe1-91d3-91cc92e8da58 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1315 microversion: 2.1 time: 0.216813 Aug 25 03:20:09.727221 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 106/206] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:09 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:09.772368 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-784a4268-9663-46ec-a386-bcab0a65ce85 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:09.773076 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-784a4268-9663-46ec-a386-bcab0a65ce85 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:09.847977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-784a4268-9663-46ec-a386-bcab0a65ce85 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:09.857482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-784a4268-9663-46ec-a386-bcab0a65ce85 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1214 microversion: 2.1 time: 0.088594 Aug 25 03:20:09.857482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 101/207] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:09 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:10.163960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:10.164562 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:10.170439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.170913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.171340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.172020 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.172469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.172884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.181805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:10.182477 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:10.188363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.188865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.189832 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.190549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.191002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.191428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.425908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:10.438770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-24ded860-7b56-49d9-9972-e29f341822e0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.276985 Aug 25 03:20:10.441754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 107/208] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:10 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:10.447081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:10.456258 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f5ed4fc0-2692-478e-912c-6ef3c32d0971 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.278246 Aug 25 03:20:10.456917 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 102/209] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:10 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:10.746565 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:10.747370 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:10.753293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.753773 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.754208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.754919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.755373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.755793 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.877071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:10.877849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:10.884037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.884521 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.885353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.887216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:10.887842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:10.888436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:10.895381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:10.904632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9f75feed-d70e-4109-9c3d-2cdccd7bd933 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1501 microversion: 2.1 time: 0.161796 Aug 25 03:20:10.909879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 108/210] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:10 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:10.965358 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:10.975863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e6d50c8c-e31f-4522-95d6-e6cd0ee151b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1218 microversion: 2.1 time: 0.102623 Aug 25 03:20:10.977153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 103/211] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:10 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:11.461938 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:11.462589 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:11.468464 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:11.468929 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:11.469357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:11.470041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:11.470558 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:11.471168 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:11.480533 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:11.481636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:11.488193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:11.489242 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:11.489907 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:11.490844 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:11.491492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:11.492122 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:11.773821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:11.789563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c59eb66b-d522-4731-aaae-acb2b5eb713d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.310713 Aug 25 03:20:11.789563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 104/212] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:11 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:11.816349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:11.825542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0abf3c3b-ef92-4b83-a555-9da9d2445457 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.367429 Aug 25 03:20:11.826407 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 109/213] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:11 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:11.999700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:12.000234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:12.007296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:12.012601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:12.012601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:12.012601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:12.012601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:12.013374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:12.080531 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:12.088365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aebe22b4-a9ed-453e-be86-947f737071af tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1218 microversion: 2.1 time: 0.092597 Aug 25 03:20:12.088948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 105/214] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:11 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:12.809527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:12.811526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:12.819971 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:12.821551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:12.822629 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:12.824459 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:12.827323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:12.827323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:12.861030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:12.861946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:12.870590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:12.871135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:12.871795 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:12.872861 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:12.873596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:12.877177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:13.040750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:13.045375 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8860f3e1-141c-45cf-82dd-6eb67082bb0d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.239465 Aug 25 03:20:13.059089 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 110/215] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:12 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:13.074668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:13.087720 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ab3a4e6a-c1fe-4c5b-babf-3059924ab3f2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.243566 Aug 25 03:20:13.088582 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 106/216] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:12 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:13.109301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:13.110116 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:13.116446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:13.117110 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:13.117690 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:13.118723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:13.119399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:13.120005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:13.125057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:13.195123 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:13.210736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9584b3a4-e260-4906-87c5-dc111320f78b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1218 microversion: 2.1 time: 0.104666 Aug 25 03:20:13.213306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 111/217] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:13 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:13.888165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0a51f85-b29d-402f-9280-426223beca69"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:13.890568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:13.897597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:13.898422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:13.899180 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:13.900342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:13.901105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:13.901842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:14.068161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:14.069747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:14.078349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:14.084732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:14.085877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:14.087267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:14.094972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:14.095980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:14.330829 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:14.338872 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5d30eb83-c48b-4f46-b7f5-29b5e76a0d3a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.275491 Aug 25 03:20:14.339421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 112/218] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:14 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:14.352444 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:14.356363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:14.375027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:14.375908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:14.377667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:14.378643 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:14.379089 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:14.379567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:14.541762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:14.549905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c376fd47-e77e-4b2e-99d0-7f59cd7e9a59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1321 microversion: 2.1 time: 0.209509 Aug 25 03:20:14.550515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 113/219] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:14 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:14.555101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:14.555716 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:14.561400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:14.561856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:14.562490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:14.563356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:14.564413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:14.564826 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:14.629251 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:14.638732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-908cdb71-e25d-46a2-82f8-c66d138d7f53 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1266 microversion: 2.1 time: 0.085892 Aug 25 03:20:14.638732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 114/220] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:14 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:15.361584 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:15.362330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:15.370651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.373629 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.374516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.377209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.377963 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.379753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.537064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:15.545768 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b1a54ac-08a7-4fba-8643-4375ab45a96f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.188823 Aug 25 03:20:15.546394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 115/221] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:15 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:15.573868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:15.574792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:15.580956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.581425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.585214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.585214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.585214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.585214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.674879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0cd9034c-1787-4bcb-a0a1-7a3409969efc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "POST /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.790395 Aug 25 03:20:15.675904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 107/222] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:20:13 2022] POST /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4/os-volume_attachments => generated 194 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:15.683250 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:15.684149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:15.691852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.692340 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.692785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.693484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.694088 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.694676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.790935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:15.793833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:15.803328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-78a0d219-59d9-4661-9bae-adf420b4b931 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1516 microversion: 2.1 time: 0.233314 Aug 25 03:20:15.803911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 116/223] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:15 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:15.804093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-52a31035-6086-4457-bcc4-8eabe7bc7c48 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1266 microversion: 2.1 time: 0.126624 Aug 25 03:20:15.804716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 108/224] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:15 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:15.830786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:15.833131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:15.838958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.839438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.839869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.840562 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:15.841010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:15.841428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:15.865165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lazy-loading 'flavor' on Instance uuid e51885fa-4bf2-4ac7-83f2-f2602026abef {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:20:16.257050 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-66de8ff0-b9cf-460e-ac41-725e6999d539 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef/action" status: 200 len: 32 microversion: 2.1 time: 0.431739 Aug 25 03:20:16.257661 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 109/225] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:20:15 2022] POST /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef/action => generated 32 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:20:16.270425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:16.271031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:16.276953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:16.277426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:16.277855 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:16.278561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:16.279011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:16.281536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:16.413979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:16.422046 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e34acb29-9675-460f-b3ae-1f36d92a0ddc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.155771 Aug 25 03:20:16.422845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 117/226] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:16 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:16.568899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:16.569749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:16.577439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:16.578239 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:16.578887 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:16.580349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:16.580970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:16.581593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:16.757717 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:16.765638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-47c92c40-bd97-455d-8d33-56683b21a6e8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.201324 Aug 25 03:20:16.766589 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 110/227] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:16 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:16.838204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:16.838890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:16.844890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:16.845401 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:16.845832 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:16.846540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:16.846992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:16.847417 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:16.930924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:16.941292 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2276bce9-c30e-4d76-acc2-2931dac4aed9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1266 microversion: 2.1 time: 0.106956 Aug 25 03:20:16.941862 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 118/228] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:16 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:17.442830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:17.443463 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:17.450116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:17.450611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:17.451044 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:17.451737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:17.452181 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:17.452599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:17.456626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:17.598025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:17.607131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7830d5f6-3ca3-4377-9a52-7e6288d8e893 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.168090 Aug 25 03:20:17.607711 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 111/229] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:17 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:17.787128 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:17.787910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:17.794150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:17.794746 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:17.799064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:17.799064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:17.799064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:17.799064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:17.942072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:17.952868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-55815b7f-2499-4624-91b7-15ed51498111 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.167504 Aug 25 03:20:17.952868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 119/230] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:17 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:17.962827 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:17.964408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:17.975147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:17.975835 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:17.976822 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:17.978217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:17.978860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:17.979422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:18.012031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-98fc6ae6-26c5-4a7e-8a3f-3712c8f18024 req-fd56129c-7477-44c3-b711-bb047debdfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89", "name": "network-vif-plugged", "status": "completed", "tag": "2633e92d-506e-4aa5-964a-5eee157a0a48"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:18.024618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-98fc6ae6-26c5-4a7e-8a3f-3712c8f18024 req-fd56129c-7477-44c3-b711-bb047debdfec service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:18.025482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-98fc6ae6-26c5-4a7e-8a3f-3712c8f18024 req-fd56129c-7477-44c3-b711-bb047debdfec service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:18.025590 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-98fc6ae6-26c5-4a7e-8a3f-3712c8f18024 req-fd56129c-7477-44c3-b711-bb047debdfec service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:18.037458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-98fc6ae6-26c5-4a7e-8a3f-3712c8f18024 req-fd56129c-7477-44c3-b711-bb047debdfec service nova] Creating event network-vif-plugged:2633e92d-506e-4aa5-964a-5eee157a0a48 for instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 on hv-cinder-85164 Aug 25 03:20:18.042850 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-98fc6ae6-26c5-4a7e-8a3f-3712c8f18024 req-fd56129c-7477-44c3-b711-bb047debdfec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035009 Aug 25 03:20:18.044566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 120/231] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:18.067583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:18.075514 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4df5da90-719b-4826-8dd8-6dd65d054f25 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1266 microversion: 2.1 time: 0.116571 Aug 25 03:20:18.076093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 112/232] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:17 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:18.625499 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:18.626302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:18.631572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:18.632583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:18.639707 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:18.640188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:18.640619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:18.641310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:18.641761 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:18.642181 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:18.785890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:18.793821 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b39ce7f3-ef18-4112-a692-138d641e8157 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.169188 Aug 25 03:20:18.794814 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 121/233] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:18 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:18.972560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:18.973175 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:18.979976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:18.983476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:18.983476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:18.983476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:18.983476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:18.983797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:19.097794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:19.098422 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:19.104528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:19.104999 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:19.105423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:19.106111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:19.106613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:19.107085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:19.121780 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:19.130118 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0ca2f663-385b-49ec-b248-933e89d714aa tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.161721 Aug 25 03:20:19.130738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 113/234] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:18 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:19.175490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:19.186969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9f4da017-03af-4d55-ab11-b85bd41a5e6f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1266 microversion: 2.1 time: 0.093783 Aug 25 03:20:19.187557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 122/235] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:19 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:19.817161 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:19.818127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:19.825605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:19.826406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:19.827096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:19.828106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:19.829102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:19.830391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:19.853148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=4 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:20.152434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:20.153065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:20.153942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:20.160434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:20.161196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:20.161835 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:20.162756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:20.163201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:20.163883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:20.166677 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-81414e90-0f49-493c-a85c-0a23395f7dd3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.354801 Aug 25 03:20:20.169177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 114/236] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:19 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:20.206893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:20.207919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:20.214190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:20.214695 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:20.215117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:20.215803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:20.216245 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:20.216655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:20.300416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:20.317315 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4b4f5c51-409f-4816-a04b-1b7af99da681 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1272 microversion: 2.1 time: 0.114023 Aug 25 03:20:20.330487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 115/237] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:20 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1272 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:20.372925 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:20.381341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f37ae433-94a9-41b3-aeff-947f8f5e957d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.233695 Aug 25 03:20:20.403481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 123/238] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:20 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:21.190385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:21.191098 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:21.197536 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:21.198017 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:21.198492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:21.199520 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:21.199960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:21.200384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:21.357648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:21.357648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:21.357648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:21.358250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:21.358498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:21.359567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:21.360193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:21.360994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:21.539320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:21.546503 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d33e8353-e49c-4784-ba10-81f1cca5a03c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.360638 Aug 25 03:20:21.558824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 116/239] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:21 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:21.568163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:21.579038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:21.585063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:21.585850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:21.586462 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:21.587349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:21.587797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:21.588217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:21.661732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:21.670306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3a5677cd-1a56-4df6-897e-a98efd0243eb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.327173 Aug 25 03:20:21.670881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 124/240] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:21 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:21.731156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:21.739213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-22bfbe1d-3f70-43b7-b2b3-52c8bec817b1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.179346 Aug 25 03:20:21.739785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 117/241] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:21 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:22.570820 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:22.571425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:22.577615 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:22.578097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:22.578550 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:22.579240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:22.580339 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:22.580707 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:22.691735 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:22.692344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:22.698732 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:22.699484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:22.699901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:22.700591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:22.701042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:22.701469 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:22.719165 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:22.726780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c5df11e0-b8ed-4874-8c3a-d5a7aa3001da tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.159740 Aug 25 03:20:22.727369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 125/242] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:22 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:22.760308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:22.760836 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:22.766604 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:22.767147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:22.768069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:22.768757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:22.769207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:22.769628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:22.859142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:22.866958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e69a2f12-b522-490c-a18c-6fc62756ed18 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.179502 Aug 25 03:20:22.867553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 118/243] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:22 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:22.919575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:22.927816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5da64751-e801-4c5f-ba54-dc9976f61f2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.171387 Aug 25 03:20:22.928409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 126/244] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:22 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:23.747557 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:23.748171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:23.755004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:23.755487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:23.755922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:23.756615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:23.757138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:23.757488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:23.881626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c97f1d53-54f6-495b-832e-f9c0594715f2 req-3a3d295a-773c-424d-92ce-c6415a42d191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804e936c-7738-4792-8ae8-ccce320f072f", "tag": "93b226d2-7259-43ca-a840-96f2ec37bd65"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:23.891343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c97f1d53-54f6-495b-832e-f9c0594715f2 req-3a3d295a-773c-424d-92ce-c6415a42d191 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:23.891927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c97f1d53-54f6-495b-832e-f9c0594715f2 req-3a3d295a-773c-424d-92ce-c6415a42d191 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:23.892887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c97f1d53-54f6-495b-832e-f9c0594715f2 req-3a3d295a-773c-424d-92ce-c6415a42d191 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:23.904456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c97f1d53-54f6-495b-832e-f9c0594715f2 req-3a3d295a-773c-424d-92ce-c6415a42d191 service nova] Creating event network-changed:93b226d2-7259-43ca-a840-96f2ec37bd65 for instance 804e936c-7738-4792-8ae8-ccce320f072f on hv-cinder-85164 Aug 25 03:20:23.908502 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:23.910115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c97f1d53-54f6-495b-832e-f9c0594715f2 req-3a3d295a-773c-424d-92ce-c6415a42d191 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032148 Aug 25 03:20:23.910950 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 127/245] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:20:23.916174 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:23.916324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1665f888-4359-4a4a-af5a-2ecca2e13ea3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.172596 Aug 25 03:20:23.916862 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:23.917010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 119/246] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:23 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:23.930024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:23.930024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:23.931377 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:23.931377 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:23.932090 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:23.932606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:23.961676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:23.962418 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:23.968605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:23.969087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:23.969570 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:23.970941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:23.971392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:23.971812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:24.120331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:24.128660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-52ff3b8f-498d-4950-80e6-9349f8883f40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.216452 Aug 25 03:20:24.129244 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 128/247] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:23 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:24.144749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:24.154672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4f77cb63-c30a-4070-8508-c78b5d3959a7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.196875 Aug 25 03:20:24.155245 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 120/248] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:23 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:24.939270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:24.939868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:24.945870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:24.946376 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:24.946812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:24.947527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:24.947974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:24.948385 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:24.952547 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:25.082852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:25.090757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-35d86f44-346d-4264-9306-d55080679126 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.155463 Aug 25 03:20:25.091329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 129/249] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:24 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:25.149703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:25.150387 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:25.156828 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:25.157307 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:25.157749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:25.159087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:25.159541 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:25.159962 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:25.178479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:25.179115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:25.184826 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:25.185302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:25.185733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:25.186441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:25.186891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:25.187308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:25.351126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:25.358681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ef696ff5-9bb3-45b7-a65e-6d88a6869462 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.212821 Aug 25 03:20:25.359260 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 121/250] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:25 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:25.361898 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:25.369666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ef4f6c39-86f9-4cd7-bf4c-6916f75a49d6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.195074 Aug 25 03:20:25.370327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 130/251] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:25 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:26.112195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:26.113424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:26.119396 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:26.119875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:26.120309 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:26.121001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:26.121452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:26.121876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:26.296556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:26.305916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5c267628-3f41-40cc-b1ef-7522b4ee1c42 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.197562 Aug 25 03:20:26.306634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 122/252] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:26 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:26.379357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:26.379984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:26.388037 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:26.388517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:26.388944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:26.389642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:26.390086 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:26.390752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:26.391417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:26.392407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:26.399456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:26.400103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:26.400529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:26.401213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:26.401700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:26.402179 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:26.685704 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:26.687773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:26.697073 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-42066134-c2ec-43d9-a3c8-09930281d9dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.318742 Aug 25 03:20:26.708778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 131/253] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:26 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:26.713773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-97d6f99d-3758-4f75-8d6b-bd1a98403357 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.327316 Aug 25 03:20:26.714842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 123/254] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:26 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:27.327805 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:27.328469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:27.330631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:27.336111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:27.336598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:27.337027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:27.337760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:27.338224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:27.341694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:27.484583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:27.492754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e079b4f6-1bd0-426e-9c86-99996b2f8b78 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.169140 Aug 25 03:20:27.493324 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 132/255] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:27 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:27.715801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:27.716542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:27.723372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:27.724312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:27.724312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:27.724978 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:27.725432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:27.725854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:27.739572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:27.740411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:27.767948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:27.768945 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:27.770633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:27.772750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:27.773516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:27.774057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:28.032605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:28.044006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2b3d3f5d-486a-47b5-9039-26f34c6a51f3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.332015 Aug 25 03:20:28.057569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 124/256] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:27 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:28.058089 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:28.066273 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b3429616-2967-4d0b-813b-2f851cb8ba24 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1363 microversion: 2.1 time: 0.334264 Aug 25 03:20:28.070393 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 133/257] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:27 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:28.513341 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:28.513751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:28.515637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=84 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:28.521283 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:28.521761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:28.522190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:28.522915 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:28.523365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:28.523789 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:28.674105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:28.682063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c41adaa9-4d16-485b-81a1-7e7adf38e668 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.172712 Aug 25 03:20:28.682687 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 125/258] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:28 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:29.065515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:29.066567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:29.072303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.072787 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.073220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:29.073914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.074654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.078054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:29.092037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:29.092863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:29.099059 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.099605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.100103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:29.100859 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.101302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.101715 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:29.268854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:29.277565 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4a4f092a-af63-4348-88f6-b2efc381a0be tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.216389 Aug 25 03:20:29.286360 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 134/259] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:29 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:29.286465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:29.287646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b6d333b9-ce49-415c-a02d-dbe5afbe9dc3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1549 microversion: 2.1 time: 0.204317 Aug 25 03:20:29.288222 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 126/260] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:29 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1549 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:29.308364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:29.308850 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:29.314748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.315232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.315700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:29.316382 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.316831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.317251 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:29.437389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b3beac8d-1bc0-464c-be19-ef04c0946656 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131857 Aug 25 03:20:29.437389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 135/261] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:20:29 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:29.703656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:29.704252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:29.710617 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.711090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.711518 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:29.712198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:29.712644 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:29.713055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:30.224629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:30.228924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:30.233787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-44e436d3-1a60-4a21-b6fb-ca74a38173e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.534200 Aug 25 03:20:30.234592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 127/262] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:29 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:30.304877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:30.305480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:30.311713 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:30.312387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:30.313003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:30.313924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:30.314410 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:30.315011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:30.506762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:30.514853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4336cd14-f6aa-4a08-b567-60779373e65c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.213888 Aug 25 03:20:30.515521 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 136/263] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:30 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:30.973406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-b02f74c6-4639-405a-8641-bee276785f31 req-203989e4-883f-4f81-a9ed-a4449040c0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89", "tag": "2633e92d-506e-4aa5-964a-5eee157a0a48"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:30.982811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-b02f74c6-4639-405a-8641-bee276785f31 req-203989e4-883f-4f81-a9ed-a4449040c0f1 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:30.983273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-b02f74c6-4639-405a-8641-bee276785f31 req-203989e4-883f-4f81-a9ed-a4449040c0f1 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:30.983694 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-b02f74c6-4639-405a-8641-bee276785f31 req-203989e4-883f-4f81-a9ed-a4449040c0f1 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:30.995050 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-b02f74c6-4639-405a-8641-bee276785f31 req-203989e4-883f-4f81-a9ed-a4449040c0f1 service nova] Creating event network-changed:2633e92d-506e-4aa5-964a-5eee157a0a48 for instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 on hv-cinder-85164 Aug 25 03:20:31.000185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-b02f74c6-4639-405a-8641-bee276785f31 req-203989e4-883f-4f81-a9ed-a4449040c0f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031154 Aug 25 03:20:31.000981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 128/264] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:31.256310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:31.257243 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:31.263501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:31.264181 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:31.264709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:31.265750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:31.266403 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:31.266922 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:31.407753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:31.416017 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-17786bdd-969b-4d27-a570-ffedad43b092 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.164732 Aug 25 03:20:31.416575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 137/265] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:31 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:31.537646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:31.538783 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:31.544986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:31.545460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:31.545889 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:31.546600 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:31.547045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:31.547462 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:31.680730 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:31.685965 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-038fcf44-c81c-488b-8465-9c56d16cb964 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.153553 Aug 25 03:20:31.686567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 129/266] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:31 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:32.437779 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:32.438434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:32.445022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:32.445509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:32.445944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:32.446670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:32.447158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:32.447708 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:32.678940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:32.686739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2a25360b-6e41-4bc5-b422-9abbddd3bfc6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.253479 Aug 25 03:20:32.687240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 138/267] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:32 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:32.707591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:32.708199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:32.714607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:32.715081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:32.715509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:32.716192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:32.716635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:32.717052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:32.916447 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:32.924058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-749f0d60-8801-4322-97ca-8c10744de890 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.220319 Aug 25 03:20:32.924626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 130/268] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:32 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:33.709176 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:33.709850 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:33.718180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:33.718733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:33.719171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:33.719910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:33.720400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:33.720942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:33.851327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:33.859528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d48601d2-2844-4c2d-8919-3d4b7fb14d4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.154977 Aug 25 03:20:33.860274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 139/269] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:33 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:33.944745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:33.945517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:33.953609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:33.954077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:33.954539 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:33.955528 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:33.956217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:33.956635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:34.090045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:34.097693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5f17807e-9d69-4cb3-a8ad-be387e5e00dc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.157504 Aug 25 03:20:34.098257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 131/270] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:33 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:34.884105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:34.884813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:34.891884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:34.892375 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:34.892812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:34.893522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:34.893974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:34.894914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:35.033706 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:35.041852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a4451098-b9a6-4746-b8ab-16797c2cb30f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.161645 Aug 25 03:20:35.042597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 140/271] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:34 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:35.118002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:35.118657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:35.124980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:35.125456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:35.125886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:35.126601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:35.127054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:35.127471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:35.257801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:35.265517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f10a7aeb-c95b-44e5-b54f-f29605229fdc tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.151338 Aug 25 03:20:35.266094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 132/272] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:35 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:36.063589 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:36.064189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:36.070440 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:36.070924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:36.071349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:36.072032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:36.072477 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:36.072895 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:36.213413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:36.221278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9d6e3349-52a5-468f-8a58-1ae054ae126c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.161656 Aug 25 03:20:36.221872 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 141/273] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:36 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:36.293762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:36.294220 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:36.302940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:36.304350 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:36.307549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:36.312077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:36.312077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:36.312077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:36.446397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:36.454119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fc348afc-a9af-41e9-af62-ba03907617ae tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.164298 Aug 25 03:20:36.454724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 133/274] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:36 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:37.243379 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:37.254456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:37.254456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:37.254456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:37.254456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:37.254800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:37.254800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:37.254800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:37.382854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:37.391363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-be582813-02b4-4050-9e18-d243c6564380 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.151699 Aug 25 03:20:37.392307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 142/275] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:37 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:37.475079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:37.479246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:37.482005 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:37.482525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:37.482956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:37.483642 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:37.484091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:37.484543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:37.619630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:37.627284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-55654547-321c-432a-aa95-6d330c1f42ab tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.156496 Aug 25 03:20:37.627860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 134/276] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:37 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:38.411998 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:38.412649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:38.418549 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:38.419028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:38.419592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:38.420287 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:38.420742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:38.421164 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:38.566643 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:38.574260 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-89fb7b6d-ed71-44f6-9230-dba1517fb7e8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.166565 Aug 25 03:20:38.575097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 143/277] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:38 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:38.648798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:38.649408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:38.656405 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:38.657097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:38.657556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:38.658249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:38.658744 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:38.659150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:38.793789 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:38.802053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-172ac330-21b5-43e0-8f7f-78c6d1d1f0f5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.157664 Aug 25 03:20:38.802659 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 135/278] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:38 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:39.597383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:39.598471 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:39.608928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:39.609419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:39.609968 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:39.610990 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:39.611591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:39.612171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:39.812355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:39.822837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:39.825743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:39.830509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e27e276d-a7b5-4539-91fa-291c1a2d2585 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.232327 Aug 25 03:20:39.830509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 144/279] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:39 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:39.837396 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:39.837880 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:39.838338 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:39.839662 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:39.840186 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:39.840587 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:39.985519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-a432994e-d87e-4079-b2e8-37585767e24b req-10df91ef-e7b9-49d7-941f-e68ecb57e6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804e936c-7738-4792-8ae8-ccce320f072f", "name": "network-vif-plugged", "status": "completed", "tag": "93b226d2-7259-43ca-a840-96f2ec37bd65"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:40.029512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a432994e-d87e-4079-b2e8-37585767e24b req-10df91ef-e7b9-49d7-941f-e68ecb57e6ad service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:40.031994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a432994e-d87e-4079-b2e8-37585767e24b req-10df91ef-e7b9-49d7-941f-e68ecb57e6ad service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:40.032937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a432994e-d87e-4079-b2e8-37585767e24b req-10df91ef-e7b9-49d7-941f-e68ecb57e6ad service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:40.055220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-a432994e-d87e-4079-b2e8-37585767e24b req-10df91ef-e7b9-49d7-941f-e68ecb57e6ad service nova] Creating event network-vif-plugged:93b226d2-7259-43ca-a840-96f2ec37bd65 for instance 804e936c-7738-4792-8ae8-ccce320f072f on hv-cinder-85164 Aug 25 03:20:40.069949 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-a432994e-d87e-4079-b2e8-37585767e24b req-10df91ef-e7b9-49d7-941f-e68ecb57e6ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098009 Aug 25 03:20:40.071128 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 145/280] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:20:40.118604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:40.127264 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-23e827f6-0290-4e63-8ddf-1c178f6b74e9 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.308402 Aug 25 03:20:40.129679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 136/281] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:39 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:40.849647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:40.850343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:40.872723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:40.873310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:40.873751 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:40.874510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:40.874964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:40.875378 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:41.090003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:41.095699 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:41.102392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-253da2bf-a376-4bed-bb36-3abf64b219ee tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.256845 Aug 25 03:20:41.103622 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 146/282] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:40 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:41.149702 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:41.150382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:41.156981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:41.157471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:41.157904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:41.158678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:41.159356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:41.159780 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:41.333658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:41.345220 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5dee232b-6d35-495a-9faa-056455b03ee8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.200330 Aug 25 03:20:41.345943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 137/283] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:41 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:42.016473 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:42.017008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:42.023975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.024449 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.024898 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.025561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.026008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.026467 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.050389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:20:42.130858 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:42.131656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:42.139832 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.140408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.140901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.141657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.142409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.142980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.310445 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:42.321283 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b7ca0577-9b57-4264-acf9-e9e206cd70c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.195205 Aug 25 03:20:42.325181 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 138/284] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:42 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:42.367353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:42.375757 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:42.385588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.386216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.386826 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.396089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.396089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.396089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.419299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d8b01687-ac40-4a41-a0f6-b6aacf71e86d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 204 len: 0 microversion: 2.1 time: 0.406323 Aug 25 03:20:42.420187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 147/285] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:20:42 2022] DELETE /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:20:42.431315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:42.432015 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:42.439335 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.440011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.440695 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.441818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:42.442501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:42.443151 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:42.580184 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:42.592604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8c99809a-658c-4806-9828-4762b0f141ef tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.227894 Aug 25 03:20:42.592604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 139/286] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:42 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:42.617301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:42.629438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f0a68828-6987-4f58-9ec0-5cb415aa72b2 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1553 microversion: 2.1 time: 0.203725 Aug 25 03:20:42.630172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 148/287] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:42 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:43.346089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:43.347357 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:43.356680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:43.357166 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:43.357601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:43.358313 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:43.358767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:43.359188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:43.508700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:43.525294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-83c8e217-f907-4873-99a1-4c0cf093e7ed tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.174824 Aug 25 03:20:43.531284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 140/288] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:43 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:43.613137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:43.614579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:43.622442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:43.623239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:43.623750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:43.624792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:43.625626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:43.628130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:43.656755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:43.657566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:43.672653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:43.675485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:43.675485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:43.675735 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:43.676932 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:43.677470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:44.036188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:44.045274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f0e49337-6464-4b57-bfd9-6066ded9a8c6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1314 microversion: 2.1 time: 0.435704 Aug 25 03:20:44.050964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 149/289] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:43 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:44.069435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:44.079812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-348a3923-9f47-4ff0-ac82-96411cc5a7eb tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1553 microversion: 2.1 time: 0.430623 Aug 25 03:20:44.080657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 141/290] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:43 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1553 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:44.542251 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:44.542882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:44.550686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:44.551092 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:44.551522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:44.555535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:44.555535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:44.555535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:44.715962 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:44.725189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cca31547-96a3-4233-a3ac-2b7dc8406c5d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.187592 Aug 25 03:20:44.726195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 150/291] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:44 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:45.066063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:45.066709 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:45.073206 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:45.073690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:45.074119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:45.075094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:45.075541 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:45.075963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:45.101774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:45.102600 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:45.109072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:45.109801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:45.115134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:45.115134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:45.115134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:45.115134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:45.268484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:45.276845 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aa4f4ede-83c7-45ad-be9c-698dcde3d1b3 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1497 microversion: 2.1 time: 0.214451 Aug 25 03:20:45.277647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 142/292] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:45 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:45.312711 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:45.322655 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cb076c70-1ffd-4a33-9fb1-1dd3a3006439 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1553 microversion: 2.1 time: 0.225267 Aug 25 03:20:45.323229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 151/293] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:45 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:45.747206 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:45.747928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:45.754852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:45.755547 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:45.755985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:45.756682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:45.757134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:45.757557 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:45.892805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:45.901233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e8759093-da49-404e-88a7-d8045d8df85b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.158094 Aug 25 03:20:45.901809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 143/294] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:45 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:46.344065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:46.344802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:46.352684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:46.353591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:46.354114 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:46.355064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:46.355584 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:46.356188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:46.494187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:46.502361 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e241e916-951f-4d3d-9d4b-a926816da752 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1553 microversion: 2.1 time: 0.162211 Aug 25 03:20:46.502923 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 152/295] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:46 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:46.921862 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:46.923086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:46.929526 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:46.929999 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:46.930458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:46.931142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:46.931582 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:46.932066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:47.218018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:47.226939 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-709c78c6-ec34-4779-bbd0-5227c61f3674 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.308955 Aug 25 03:20:47.227660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 144/296] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:46 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:47.522824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:47.523431 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:47.529472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:47.529951 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:47.530424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:47.531158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:47.531605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:47.532022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:47.666456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:47.674652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c51e279d-28e5-47da-9a76-fb3eae78a4f6 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1553 microversion: 2.1 time: 0.156243 Aug 25 03:20:47.677767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 153/297] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:47 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:48.247406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:48.247935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:48.254246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:48.254803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:48.255234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:48.255913 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:48.256362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:48.256778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:48.260755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:48.385786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:48.393327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b987ff23-97c7-4f41-88bb-d203c0cc03af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.149848 Aug 25 03:20:48.393889 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 145/298] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:48 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:48.695979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:48.696583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:48.702782 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:48.703256 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:48.703685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:48.704388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:48.704831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:48.705273 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:48.829877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:48.838724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-692aa76b-b679-44d5-8e35-bbbfec8f145b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1553 microversion: 2.1 time: 0.146575 Aug 25 03:20:48.839299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 154/299] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:48 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:49.414698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:49.415297 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:49.421773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:49.422238 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:49.422696 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:49.423368 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:49.423807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:49.424216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:49.555282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:49.562869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-78b312c0-9ee1-4c52-a048-870de61601c5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.151943 Aug 25 03:20:49.563440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 146/300] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:49 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:49.861081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:49.862080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:49.870655 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:49.871410 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:49.872061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:49.873131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:49.873854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:49.874549 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.007423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:50.015892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-02407015-690c-4d67-90a8-e3dc345d1901 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1553 microversion: 2.1 time: 0.160865 Aug 25 03:20:50.016507 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 155/301] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:49 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:50.428836 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-de42cf4b-f773-443f-b1b0-fa7569644348 req-2c26fc62-b6e8-42ba-bd3f-e1d0fc2b66cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43663cc7-978f-486b-806b-ffaf5e6f19d4", "name": "network-vif-unplugged", "status": "completed", "tag": "b798688d-53a9-4934-8eaa-792032011dc8"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:50.439974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-de42cf4b-f773-443f-b1b0-fa7569644348 req-2c26fc62-b6e8-42ba-bd3f-e1d0fc2b66cc service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.440441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-de42cf4b-f773-443f-b1b0-fa7569644348 req-2c26fc62-b6e8-42ba-bd3f-e1d0fc2b66cc service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.440856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-de42cf4b-f773-443f-b1b0-fa7569644348 req-2c26fc62-b6e8-42ba-bd3f-e1d0fc2b66cc service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.453641 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-de42cf4b-f773-443f-b1b0-fa7569644348 req-2c26fc62-b6e8-42ba-bd3f-e1d0fc2b66cc service nova] Creating event network-vif-unplugged:b798688d-53a9-4934-8eaa-792032011dc8 for instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 on hv-cinder-85164 Aug 25 03:20:50.459352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-de42cf4b-f773-443f-b1b0-fa7569644348 req-2c26fc62-b6e8-42ba-bd3f-e1d0fc2b66cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034351 Aug 25 03:20:50.459939 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 147/302] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:50.520768 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:50.521563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:50.530328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.530328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.530328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.530328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.530758 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.530758 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.556493 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:20:50.586199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:50.587006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:50.593828 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.594339 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.594776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.595472 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.595922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.596342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.836104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8a4ab371-970e-40c2-9a20-31b310c6a701 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "DELETE /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 204 len: 0 microversion: 2.1 time: 0.319135 Aug 25 03:20:50.836690 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 156/303] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:20:50 2022] DELETE /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:20:50.842645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-07cf51b4-4bea-4372-8e35-7d0c10d7140a req-b3e3c1ac-df6b-4d9e-b0e4-55ae3358790a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43663cc7-978f-486b-806b-ffaf5e6f19d4", "name": "network-vif-deleted", "tag": "b798688d-53a9-4934-8eaa-792032011dc8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:50.853285 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-07cf51b4-4bea-4372-8e35-7d0c10d7140a req-b3e3c1ac-df6b-4d9e-b0e4-55ae3358790a service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.853493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:50.854130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-07cf51b4-4bea-4372-8e35-7d0c10d7140a req-b3e3c1ac-df6b-4d9e-b0e4-55ae3358790a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.854754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-07cf51b4-4bea-4372-8e35-7d0c10d7140a req-b3e3c1ac-df6b-4d9e-b0e4-55ae3358790a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.864378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2b2b25b6-d296-4dc0-84c9-b8f89480e479 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.284004 Aug 25 03:20:50.865647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 148/304] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:50 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:50.867378 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-07cf51b4-4bea-4372-8e35-7d0c10d7140a req-b3e3c1ac-df6b-4d9e-b0e4-55ae3358790a service nova] Creating event network-vif-deleted:b798688d-53a9-4934-8eaa-792032011dc8 for instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 on hv-cinder-85164 Aug 25 03:20:50.870707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:50.871307 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:50.872413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-07cf51b4-4bea-4372-8e35-7d0c10d7140a req-b3e3c1ac-df6b-4d9e-b0e4-55ae3358790a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034090 Aug 25 03:20:50.873441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 157/305] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:50.883478 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.884063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.884560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:50.885496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:50.886016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:50.891658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:51.019838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:51.028072 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-acfc209a-167c-4162-b8d8-90fb37cf6172 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1503 microversion: 2.1 time: 0.161303 Aug 25 03:20:51.028633 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 149/306] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:50 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:51.037890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:51.038672 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:51.044769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:51.045240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:51.045666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:51.046363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:51.046806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:51.047220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:51.111665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:51.121020 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-09579f17-1923-43aa-9286-a8bbd1194f9b tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1511 microversion: 2.1 time: 0.087420 Aug 25 03:20:51.121748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 158/307] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:51 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:51.884937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:51.885638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:51.892202 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:51.892683 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:51.893119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:51.893875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:51.894348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:51.894777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:52.031994 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:52.040487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4b75e929-7897-439a-bbf7-081f3b2f8a5c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.159478 Aug 25 03:20:52.041050 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 150/308] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:51 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:52.048859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:52.049478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:52.058754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:52.059235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:52.059660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:52.060349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:52.060791 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:52.061202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:52.146758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:52.149216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:52.154737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:52.156207 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:52.156851 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:52.158116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:52.158808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:52.159990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:52.229433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:52.236956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8d9fd71b-6b50-4401-9dcb-0f5fa9d5d672 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1503 microversion: 2.1 time: 0.192556 Aug 25 03:20:52.237687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 159/309] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:52 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:52.258606 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:52.271060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6f035813-00f9-41d1-a925-ef83207b2fcc tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1511 microversion: 2.1 time: 0.131585 Aug 25 03:20:52.284896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 151/310] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:52 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1511 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:53.062318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:53.062921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:53.069682 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.070166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.070629 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.071331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.071785 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.072192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.258672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:53.259829 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:53.268291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.269077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.269511 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.271956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.272663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.273264 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.304119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:53.310187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:53.320205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-82746cfc-1633-43c7-8fc7-669f8554d825 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.261659 Aug 25 03:20:53.321960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 160/311] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:53 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:53.328619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:53.329740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:53.339578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.340630 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.341856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.342341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.343076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.343644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.400590 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.401092 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.401666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.402094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lazy-loading 'fault' on Instance uuid 43663cc7-978f-486b-806b-ffaf5e6f19d4 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:20:53.497436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827bfe2d861146b3aa67cfe147dc16d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5e956906b484196945c8deb97beaf5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:53.506427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0c9c1867-425a-4d2d-91e5-56bcfcf67734 tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 200 len: 1351 microversion: 2.1 time: 0.183047 Aug 25 03:20:53.507033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 161/312] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:53 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 1351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:53.601657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:53.615546 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5d485b22-1406-43b4-8b11-1d0db4d91b9b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1503 microversion: 2.1 time: 0.361362 Aug 25 03:20:53.616651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 152/313] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:53 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:53.934092 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-0a44ad49-bd01-4328-8312-9f2d342ecf6d req-923f3e1a-6069-4909-9502-c90b0b8621b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804e936c-7738-4792-8ae8-ccce320f072f", "name": "network-vif-deleted", "tag": "93b226d2-7259-43ca-a840-96f2ec37bd65"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:53.952193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0a44ad49-bd01-4328-8312-9f2d342ecf6d req-923f3e1a-6069-4909-9502-c90b0b8621b0 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.952662 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0a44ad49-bd01-4328-8312-9f2d342ecf6d req-923f3e1a-6069-4909-9502-c90b0b8621b0 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.962429 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0a44ad49-bd01-4328-8312-9f2d342ecf6d req-923f3e1a-6069-4909-9502-c90b0b8621b0 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.965933 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-0a44ad49-bd01-4328-8312-9f2d342ecf6d req-923f3e1a-6069-4909-9502-c90b0b8621b0 service nova] Creating event network-vif-deleted:93b226d2-7259-43ca-a840-96f2ec37bd65 for instance 804e936c-7738-4792-8ae8-ccce320f072f on hv-cinder-85164 Aug 25 03:20:53.971038 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-0a44ad49-bd01-4328-8312-9f2d342ecf6d req-923f3e1a-6069-4909-9502-c90b0b8621b0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045642 Aug 25 03:20:53.971635 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 162/314] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:54.346933 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:54.347542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:54.357117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.357638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.358127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.358899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.359356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.359782 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.505558 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:54.516280 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-73326932-fff3-49cb-8aef-c967e565655d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.175524 Aug 25 03:20:54.517357 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 153/315] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:54 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:54.528549 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:54.529916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:54.538195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.538709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.539141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.539832 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.540454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.540877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.555558 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] HTTP exception thrown: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Request method failure captured: Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 HTTP/1.1 Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuohuQa5ZAIA57us6AsgXbuUz6dMlqtUSQneuHDW5VNQG-ZntUF6WkeO3S-vYwBFTrNkl6xKNlk9exwD5lW1Y-69JwCTp3Jvsathnk4BTbhUxWOuFYhusMkwOtkauxNG4_3Cye9xREWes_FYLTzkkdiIwvsE_mzb6LzH7pYNEqg570w Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:20:54.562306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5e956906b484196945c8deb97beaf5d"}]}] Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 827bfe2d861146b3aa67cfe147dc16d3 Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.563946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '43663cc7-978f-486b-806b-ffaf5e6f19d4'} Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:20:54.564608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.565859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.566943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Returning 404 to user: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:20:54.566943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-66098d80-943b-4e39-90a3-f658ccf0e44e tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 404 len: 111 microversion: 2.1 time: 0.040134 Aug 25 03:20:54.566943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 163/316] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:54 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:20:54.642647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:54.647582 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:54.656136 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.656813 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.657315 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.658020 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.658564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.659167 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.699281 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.700023 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.700571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.706507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lazy-loading 'fault' on Instance uuid 804e936c-7738-4792-8ae8-ccce320f072f {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:20:54.755014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:54.763055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b93f6d02-3593-4158-8b2a-2e3a5f7bf191 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 200 len: 1304 microversion: 2.1 time: 0.126060 Aug 25 03:20:54.764136 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 154/317] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:54 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:54.798436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:54.800665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:54.807269 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.807748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.808178 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.808869 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:54.809308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:54.809730 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.823586 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] HTTP exception thrown: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Request method failure captured: Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4/os-volume_attachments HTTP/1.1 Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuohuQa5ZAIA57us6AsgXbuUz6dMlqtUSQneuHDW5VNQG-ZntUF6WkeO3S-vYwBFTrNkl6xKNlk9exwD5lW1Y-69JwCTp3Jvsathnk4BTbhUxWOuFYhusMkwOtkauxNG4_3Cye9xREWes_FYLTzkkdiIwvsE_mzb6LzH7pYNEqg570w Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:20:54.825617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5e956906b484196945c8deb97beaf5d"}]}] Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 827bfe2d861146b3aa67cfe147dc16d3 Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.831801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'server_id': '43663cc7-978f-486b-806b-ffaf5e6f19d4'} Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:20:54.833381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:54.834887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:54.836364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Returning 404 to user: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:20:54.836364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6cd2a558-63df-4479-8d8e-39c7d7b05d8a tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032937 Aug 25 03:20:54.836364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 164/318] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:20:54 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:20:55.539944 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:55.541666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:55.549330 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:55.552987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:55.552987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:55.552987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:55.552987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:55.553331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:55.707095 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:55.717093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-55fcd967-038b-497d-9862-9be30c0485af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.181659 Aug 25 03:20:55.717490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 155/319] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:55 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:55.784492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:55.785872 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: 804e936c-7738-4792-8ae8-ccce320f072f] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:55.792335 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:55.792823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:55.793259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:55.794744 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:55.795585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:55.796027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:55.810239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] HTTP exception thrown: Instance 804e936c-7738-4792-8ae8-ccce320f072f could not be found. Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Request method failure captured: Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f HTTP/1.1 Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBupi2_H0I19ck8N5EjDjPpQleH75_ABd9GpLB210ATkGpJirKFdWVMWgEUHc0BJHSlVj1UEQDoJd8cgmOCF3Ahr1cZp5fo_fi9fgeyGkGEx3ePeAiP2sLm6jS5EE4UNtLaLJHCw_u7BKDv8LjN67kSvRZCP6xSqZs29vSv6ucJb_v_o Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 882db843d4644ac29365868d1deb9a27 Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesActionsTest-1249660405 Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:20:55.811914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/882db843d4644ac29365868d1deb9a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/882db843d4644ac29365868d1deb9a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/882db843d4644ac29365868d1deb9a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_882db843d4644ac29365868d1deb9a27"}]}] Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesActionsTest-1249660405 Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 882db843d4644ac29365868d1deb9a27 Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesActionsTest-1249660405 Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesActionsTest-1249660405-project Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 2552825edca0418392f877ea9488e36f Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesActionsTest-1249660405-project Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 804e936c-7738-4792-8ae8-ccce320f072f could not be found. Aug 25 03:20:55.813311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '804e936c-7738-4792-8ae8-ccce320f072f'} Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804e936c-7738-4792-8ae8-ccce320f072f could not be found. Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:20:55.814197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804e936c-7738-4792-8ae8-ccce320f072f could not be found. Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804e936c-7738-4792-8ae8-ccce320f072f could not be found. Aug 25 03:20:55.815823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:55.820594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Returning 404 to user: Instance 804e936c-7738-4792-8ae8-ccce320f072f could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:20:55.820594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-670ebcc6-30da-479e-9cad-f0c0ae5df840 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f" status: 404 len: 111 microversion: 2.1 time: 0.032897 Aug 25 03:20:55.820594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 165/320] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:55 2022] GET /compute/v2.1/servers/804e936c-7738-4792-8ae8-ccce320f072f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:20:55.947104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-700864359", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "networks": [{"uuid": "ca0143b6-0a6e-48e5-b8f9-c9884ef057e9"}]}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:56.001580 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] validate_networks() for [('ca0143b6-0a6e-48e5-b8f9-c9884ef057e9', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:20:56.356352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:20:56.356770 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:20:56.357234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:20:56.357630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:20:56.358057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:20:56.372668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:56.372668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:56.372668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:56.372668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:56.373038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:56.373038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:56.389067 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Getting quotas for project 882db843d4644ac29365868d1deb9a27. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:20:56.393470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Getting quotas for user 2552825edca0418392f877ea9488e36f and project 882db843d4644ac29365868d1deb9a27. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:20:56.405187 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:20:56.408990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:20:56.548792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5eac1f6c-dea9-40e3-9308-8b9e73babd2f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605528 Aug 25 03:20:56.549830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 156/321] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:20:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:20:56.562672 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f6ab8849-342c-48b7-9d11-9f8db1208401 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:56.563860 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f6ab8849-342c-48b7-9d11-9f8db1208401 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:56.630955 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f6ab8849-342c-48b7-9d11-9f8db1208401 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:56.641514 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f6ab8849-342c-48b7-9d11-9f8db1208401 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1213 microversion: 2.1 time: 0.083660 Aug 25 03:20:56.642117 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 166/322] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:56 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:56.737007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:56.737873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:56.745093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:56.745690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:56.746396 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:56.747162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:56.747818 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:56.748308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:56.886369 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:56.894775 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fbfd83e8-d462-4052-897b-a45558708932 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.161702 Aug 25 03:20:56.895994 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 157/323] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:56 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:57.661764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:57.662392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:57.668799 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:57.669559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:57.669874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:57.670953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:57.671742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:57.672168 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:57.742978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:57.753690 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f87854d8-721a-4772-94bc-1393242be765 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1217 microversion: 2.1 time: 0.095671 Aug 25 03:20:57.755994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 167/324] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:57 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:57.916901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:57.917509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:57.924276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:57.929218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:57.929218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:57.929218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:57.929218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:57.929652 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:57.987913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:57.991687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:57.995658 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:58.015921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.019133 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.020550 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.027642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.028954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.029807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.050812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] HTTP exception thrown: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Request method failure captured: Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 HTTP/1.1 Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuohuQa5ZAIA57us6AsgXbuUz6dMlqtUSQneuHDW5VNQG-ZntUF6WkeO3S-vYwBFTrNkl6xKNlk9exwD5lW1Y-69JwCTp3Jvsathnk4BTbhUxWOuFYhusMkwOtkauxNG4_3Cye9xREWes_FYLTzkkdiIwvsE_mzb6LzH7pYNEqg570w Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:20:58.053162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5e956906b484196945c8deb97beaf5d"}]}] Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 827bfe2d861146b3aa67cfe147dc16d3 Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.054760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '43663cc7-978f-486b-806b-ffaf5e6f19d4'} Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:20:58.055602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.056899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.059246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Returning 404 to user: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:20:58.062021 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e489f46-8153-4a3d-9833-0893eaeda6fe tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "DELETE /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 404 len: 111 microversion: 2.1 time: 0.078694 Aug 25 03:20:58.062021 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 168/325] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:20:57 2022] DELETE /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:20:58.069700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:58.070346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] [instance: 43663cc7-978f-486b-806b-ffaf5e6f19d4] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:58.078607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.079742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.080711 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.081762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.082428 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.087027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.099591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] HTTP exception thrown: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Request method failure captured: Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 HTTP/1.1 Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuohuQa5ZAIA57us6AsgXbuUz6dMlqtUSQneuHDW5VNQG-ZntUF6WkeO3S-vYwBFTrNkl6xKNlk9exwD5lW1Y-69JwCTp3Jvsathnk4BTbhUxWOuFYhusMkwOtkauxNG4_3Cye9xREWes_FYLTzkkdiIwvsE_mzb6LzH7pYNEqg570w Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:20:58.101526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a5e956906b484196945c8deb97beaf5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a5e956906b484196945c8deb97beaf5d"}]}] Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a5e956906b484196945c8deb97beaf5d Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669267219 Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 827bfe2d861146b3aa67cfe147dc16d3 Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-DeleteServersTestJSON-1669267219-project Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.108463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '43663cc7-978f-486b-806b-ffaf5e6f19d4'} Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:20:58.109588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. Aug 25 03:20:58.110899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:20:58.112062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] Returning 404 to user: Instance 43663cc7-978f-486b-806b-ffaf5e6f19d4 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:20:58.112062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-93f2a6ba-940c-4d5e-b33a-9ff9dae34d2d tempest-DeleteServersTestJSON-1669267219 tempest-DeleteServersTestJSON-1669267219-project] 10.222.0.58 "GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4" status: 404 len: 111 microversion: 2.1 time: 0.038771 Aug 25 03:20:58.113294 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 169/326] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:58 2022] GET /compute/v2.1/servers/43663cc7-978f-486b-806b-ffaf5e6f19d4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:20:58.150180 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:58.174646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-89ec1f31-23f7-4b8e-945c-22600d224237 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.255723 Aug 25 03:20:58.182735 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 158/327] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:57 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:58.779122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:58.780333 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:58.786981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.787678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.788284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.789149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.789747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.790350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.872105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:58.889276 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8c8a6cb0-3850-496f-9879-961a4bd97c4f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1265 microversion: 2.1 time: 0.114538 Aug 25 03:20:58.894882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 170/328] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:58 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:59.200254 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:59.201565 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:59.205300 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:59.209459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:59.210187 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:59.210668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:59.211553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:59.212017 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:59.212446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:59.405753 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:59.415630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fd0aa68f-6d97-446f-8f9b-cc5220aef784 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.223974 Aug 25 03:20:59.423295 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 159/329] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:59 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:59.913897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:59.920464 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:59.921928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:59.922437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:59.922870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:59.923546 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:59.923992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:59.924665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:00.204260 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:00.212929 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8a0caaca-39f1-4e03-9714-1011957c158f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.303271 Aug 25 03:21:00.213671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 171/330] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:59 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:00.438513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:00.439176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:00.474226 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:00.474842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:00.475284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:00.476013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:00.480935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:00.481388 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:01.237925 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:01.238770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:01.246386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:01.247205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:01.247880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:01.248674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:01.249338 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:01.249969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:01.271304 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:01.283378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1f60dfaf-bbf8-4a15-b59f-9ce3bbb74391 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.850167 Aug 25 03:21:01.284063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 160/331] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:00 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:01.470546 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:01.499019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-23e449c5-081f-4726-b93a-6c890858cce1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.264754 Aug 25 03:21:01.500150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 172/332] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:01 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:01.908529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-18558168-febd-4731-a168-e2a5f6e2e7c2 req-f1856728-dbfc-4142-a3a0-c1f95fa3d056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8341fa7-ed5e-478a-9690-5805508c0885", "tag": "8abb62c9-8848-4a81-846c-6dc081d63ee8"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:01.918850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-18558168-febd-4731-a168-e2a5f6e2e7c2 req-f1856728-dbfc-4142-a3a0-c1f95fa3d056 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:01.920670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-18558168-febd-4731-a168-e2a5f6e2e7c2 req-f1856728-dbfc-4142-a3a0-c1f95fa3d056 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:01.925452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-18558168-febd-4731-a168-e2a5f6e2e7c2 req-f1856728-dbfc-4142-a3a0-c1f95fa3d056 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:01.944677 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-18558168-febd-4731-a168-e2a5f6e2e7c2 req-f1856728-dbfc-4142-a3a0-c1f95fa3d056 service nova] Creating event network-changed:8abb62c9-8848-4a81-846c-6dc081d63ee8 for instance c8341fa7-ed5e-478a-9690-5805508c0885 on hv-cinder-85164 Aug 25 03:21:01.951508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-18558168-febd-4731-a168-e2a5f6e2e7c2 req-f1856728-dbfc-4142-a3a0-c1f95fa3d056 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047541 Aug 25 03:21:01.952631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 161/333] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:21:02.306916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:02.307738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:02.315551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:02.320150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:02.320150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:02.320150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:02.320150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:02.320650 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:02.524384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:02.525263 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:02.541569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:02.542563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:02.543159 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:02.544027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:02.549773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:02.549773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:02.836225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:02.851566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4729089d-f294-4853-a274-2eecd6003414 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.550021 Aug 25 03:21:02.852150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 173/334] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:02 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:02.950683 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:02.969129 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-21c12180-5dd9-4ba1-a2ba-2e085fe21d78 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.451632 Aug 25 03:21:02.973086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 162/335] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:02 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:03.875549 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:03.877004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:03.884111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:03.884673 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:03.885169 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:03.885941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:03.886489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:03.887342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:03.998006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:03.999584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:04.007588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:04.008394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:04.009040 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:04.009965 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:04.011233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:04.012155 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:04.052269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:04.219924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:04.230145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-98efc014-14ba-4c04-9e77-072449195b19 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1522 microversion: 2.1 time: 0.358369 Aug 25 03:21:04.231455 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 174/336] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:03 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:04.276118 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:04.285664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a5f83327-7fcd-4321-8c7b-dcc4a34d63cf tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.293587 Aug 25 03:21:04.296655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 163/337] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:03 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:05.258823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:05.265447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:05.269539 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.270771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.271275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.271968 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.272424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.273061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.313900 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:05.316064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:05.323335 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.324225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.324455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.325592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.326154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.326655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.490603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:05.497774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-caafc81b-63ae-41dd-bac4-ea035cb0be44 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1502 microversion: 2.1 time: 0.245465 Aug 25 03:21:05.498357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 175/338] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:05 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:05.526620 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:05.529957 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:05.536640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.537345 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.538195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.539452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.541014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.543395 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.588108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:05.604876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-464222c2-d476-47b8-9e0c-8f64d726f085 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.301653 Aug 25 03:21:05.605470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 164/339] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:05 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:05.742130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:05.772856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d33177b0-8d1a-46d3-a8d7-1e518bdd5be8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1516 microversion: 2.1 time: 0.249528 Aug 25 03:21:05.772856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 176/340] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:05 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:06.626019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:06.626648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:06.632983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:06.633805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:06.635481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:06.635972 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:06.636395 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:06.637893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:06.638572 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:06.639295 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:06.882785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:06.896976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ae3c01e2-2fcb-4536-a5c6-01125b54bb80 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.274959 Aug 25 03:21:06.897553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 165/341] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:06 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:07.917677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:07.918249 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:07.920404 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:07.929553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:07.930039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:07.930540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:07.931230 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:07.931837 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:07.932396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:08.120975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:08.129510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7cbb09af-c312-4c04-9aaa-a99072d1941e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.215782 Aug 25 03:21:08.130341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 177/342] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:07 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:09.156808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:09.157423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:09.168205 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:09.168847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:09.169389 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:09.170204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:09.170780 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:09.171437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:09.750249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:09.758564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1d470099-966d-4578-8293-2fbde5d855d8 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.605496 Aug 25 03:21:09.759614 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 166/343] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:09 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:09.816101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:09.819693 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:09.827226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:09.827845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:09.828445 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:09.829850 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:09.830820 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:09.831366 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:09.868395 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lazy-loading 'flavor' on Instance uuid ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:21:10.299945 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d39a5a74-a141-403d-b219-9bbddd762f4f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0/action" status: 200 len: 32 microversion: 2.1 time: 0.480727 Aug 25 03:21:10.299945 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 178/344] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:21:09 2022] POST /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0/action => generated 32 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:21:10.303757 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:10.305288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:10.312383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.313448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.314142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:10.315045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.315666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.316152 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:10.522755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:10.537857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b6c87b36-05a6-4183-b1b3-6d3f973c810b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.237680 Aug 25 03:21:10.539068 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 167/345] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:10 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:10.784421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:10.785690 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:10.795535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.796670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.797673 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:10.799386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.800087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.800771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:11.076640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:11.085584 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-221a291b-f7a4-4f40-9f15-3a2e61fd2137 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.308744 Aug 25 03:21:11.106442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 179/346] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:10 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:11.561021 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:11.562188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:11.569288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:11.569986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:11.570611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:11.571480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:11.572078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:11.572646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:11.750077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:11.760973 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f6d83226-27f8-4c53-b47b-085737168865 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.204950 Aug 25 03:21:11.762076 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 168/347] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:11 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:12.131359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:12.134767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:12.159425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:12.160209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:12.161372 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:12.162964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:12.163614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:12.164221 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:12.375728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:12.577470 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:12.590509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dd74438a-46af-424b-9ccf-c5722bb0716c tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.472827 Aug 25 03:21:12.593025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 180/348] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:12 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:12.783267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:12.791168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:12.792874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:12.793945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:12.794398 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:12.798836 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:12.802221 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:12.802961 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:13.028810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:13.045863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bff0899f-62c5-4173-b378-3803a284cb2d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.267237 Aug 25 03:21:13.049523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 169/349] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:12 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:13.070703 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1771aea2-317e-489a-bb08-6415f71740ff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: .version_select at 0x7fa33a93e0d0>, body: {"keypair": {"name": "tempest-keypair-1698721012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYNX6u35tpwIQ4olHq4heWU7kwIT2bYVCNE8XGiaalpGyXP5d2J+LVh4kCQc8h51eiDA5RuDh/d65L9Wg+R33nOAVWW491+6rcMh1UKV8BbetI8D6fR1H6d5hq6Cj52lw=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:13.109246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-1771aea2-317e-489a-bb08-6415f71740ff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:21:13.117279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-1771aea2-317e-489a-bb08-6415f71740ff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:21:13.231225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1771aea2-317e-489a-bb08-6415f71740ff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.350402 Aug 25 03:21:13.231838 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 181/350] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:21:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:21:13.613256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:13.613903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:13.621186 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:13.621681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:13.622841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:13.623249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:13.623596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:13.624273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:13.838745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:13.846137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-3e1f6723-45f8-4a4a-9983-08ccedef12f2 req-6498a885-0fb7-40f2-bd8c-19914abd7718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8341fa7-ed5e-478a-9690-5805508c0885", "name": "network-vif-plugged", "status": "completed", "tag": "8abb62c9-8848-4a81-846c-6dc081d63ee8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:13.866994 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-986ea1d3-ff4a-4b6b-916d-0bb21c54c26f tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.254102 Aug 25 03:21:13.869102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 170/351] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:13 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:13.870014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3e1f6723-45f8-4a4a-9983-08ccedef12f2 req-6498a885-0fb7-40f2-bd8c-19914abd7718 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:13.870709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3e1f6723-45f8-4a4a-9983-08ccedef12f2 req-6498a885-0fb7-40f2-bd8c-19914abd7718 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:13.871304 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3e1f6723-45f8-4a4a-9983-08ccedef12f2 req-6498a885-0fb7-40f2-bd8c-19914abd7718 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:13.893699 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-3e1f6723-45f8-4a4a-9983-08ccedef12f2 req-6498a885-0fb7-40f2-bd8c-19914abd7718 service nova] Creating event network-vif-plugged:8abb62c9-8848-4a81-846c-6dc081d63ee8 for instance c8341fa7-ed5e-478a-9690-5805508c0885 on hv-cinder-85164 Aug 25 03:21:13.905749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-3e1f6723-45f8-4a4a-9983-08ccedef12f2 req-6498a885-0fb7-40f2-bd8c-19914abd7718 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063398 Aug 25 03:21:13.916519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 182/352] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:21:14.069720 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:14.070494 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:14.077033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:14.077518 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:14.077986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:14.078755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:14.079214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:14.079637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:14.228316 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:14.236215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7131f65c-ca25-461f-b69c-0ae37a4c8df4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.170972 Aug 25 03:21:14.236951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 171/353] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:14 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:14.893239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:14.894739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:14.901536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:14.902127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:14.902729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:14.903497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:14.904061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:14.904741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:15.069911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:15.085525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-52e964b4-c177-4eca-8faa-2e8b6c7d12db tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.196242 Aug 25 03:21:15.087077 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 183/354] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:14 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:15.257099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:15.257715 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:15.265744 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:15.266237 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:15.266698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:15.267403 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:15.272289 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:15.272755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:15.495120 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:15.516175 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-389b0afc-af2a-4032-ab79-b69eedd6c8af tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.262947 Aug 25 03:21:15.516976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 172/355] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:15 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:16.064168 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1094529877", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "256737dd-9a94-4238-9f74-9979facae111"}], "security_groups": [{"name": "tempest-securitygroup--922515702"}], "key_name": "tempest-keypair-1698721012", "user_data": "}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:16.114440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:16.114440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:16.116162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:16.116707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:16.117143 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:16.117846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:16.118376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:16.118827 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:16.214376 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] validate_networks() for [('256737dd-9a94-4238-9f74-9979facae111', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:21:16.348223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:16.358917 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9c152c8a-f8dd-4f69-abf9-ecc916886b07 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1313 microversion: 2.1 time: 0.256050 Aug 25 03:21:16.370605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 173/356] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:16 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:16.542203 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:16.542846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:16.551871 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:16.557848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:16.558541 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:16.559475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:16.560086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:16.560660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:16.726609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:21:16.727030 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:21:16.727507 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:21:16.730062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:21:16.730062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:21:16.739936 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:16.740423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:16.740861 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:16.741639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:16.742274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:16.742903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:16.773714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:21:16.778420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:21:16.791127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:16.792341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:21:16.795746 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:21:16.799759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2bdac630-0722-4125-8d4f-8534052ef1f3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.261320 Aug 25 03:21:16.800350 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 174/357] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:16 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:17.006118 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5ecf2e85-6951-4a12-92db-578ecb41a7ae tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.946415 Aug 25 03:21:17.007171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 184/358] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:21:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:21:17.018949 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fe37025b-d072-42ec-9257-27fbe56d3cf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:17.019588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fe37025b-d072-42ec-9257-27fbe56d3cf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:17.078606 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fe37025b-d072-42ec-9257-27fbe56d3cf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:17.085738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fe37025b-d072-42ec-9257-27fbe56d3cf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1242 microversion: 2.1 time: 0.071357 Aug 25 03:21:17.087988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 175/359] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:17 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:17.381851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:17.382531 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:17.389200 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:17.389667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:17.390109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:17.390789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:17.391239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:17.391648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:17.560140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:17.572131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-475368e3-4960-4c4c-990a-637fdfee0321 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1496 microversion: 2.1 time: 0.194222 Aug 25 03:21:17.586331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 185/360] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:17 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1496 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:17.820901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:17.821893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:17.829006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:17.829698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:17.830130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:17.830848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:17.831294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:17.831885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:17.972420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:17.980810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ede8c371-39b9-4e97-abb9-805ec34f496f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.163856 Aug 25 03:21:17.981376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 176/361] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:17 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:18.108219 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:18.108747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:18.115074 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:18.115547 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:18.115977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:18.120179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:18.120179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:18.120179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:18.177234 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:18.185104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0a8aeef7-593c-4059-b29b-e403e05d6693 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1246 microversion: 2.1 time: 0.080846 Aug 25 03:21:18.185671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 186/362] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:18 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:19.001117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:19.001841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:19.008473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:19.009003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:19.009429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:19.010102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:19.010573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:19.010988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:19.137411 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:19.145041 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8222b3eb-c761-4a27-96d3-10f248680eb5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.148006 Aug 25 03:21:19.146115 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 177/363] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:18 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:19.205706 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:19.206336 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:19.212809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:19.213285 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:19.213718 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:19.214436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:19.214894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:19.215315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:19.277254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:19.284774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-797ffaf0-6a4d-4c6e-b56c-8dce9bfc7826 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1246 microversion: 2.1 time: 0.082869 Aug 25 03:21:19.285327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 187/364] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:19 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:20.166267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:20.166894 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:20.173185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:20.173653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:20.174080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:20.174788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:20.175237 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:20.175647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:20.302130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:20.306224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:20.306863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:20.309910 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-64b50090-bfc9-4e09-a50f-615951e9d5b4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.147498 Aug 25 03:21:20.310506 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 178/365] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:20 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:20.312816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:20.313293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:20.313723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:20.314446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:20.314897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:20.315316 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:20.377827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:20.385391 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fbec7ca5-c01f-4da3-bc36-c69b168df6de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1246 microversion: 2.1 time: 0.083397 Aug 25 03:21:20.385961 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 188/366] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:20 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:21.331354 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:21.331985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:21.339157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:21.339628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:21.340056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:21.340733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:21.341175 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:21.341595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:21.406585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:21.407097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:21.415244 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:21.415750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:21.416283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:21.417057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:21.417585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:21.418076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:21.489677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:21.497265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-558bc5f7-3249-4eab-8ec4-618db91ca535 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1246 microversion: 2.1 time: 0.094732 Aug 25 03:21:21.500908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:21.508771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 189/367] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:21 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:21.509364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1471f556-163d-4c3c-a4cb-0ff31dc611ba tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.181908 Aug 25 03:21:21.509922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 179/368] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:21 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:22.520097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:22.521617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:22.530377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:22.531049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:22.536720 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:22.537196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:22.537621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:22.538106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:22.538324 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:22.538776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:22.538941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:22.539184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:22.539592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:22.540442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:22.541009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:22.541902 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:22.631985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:22.641983 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c91fe3ae-ba01-4e94-a22d-fa1e447c7f0a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1246 microversion: 2.1 time: 0.125793 Aug 25 03:21:22.642590 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 190/369] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:22 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:22.711860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:22.719544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aec5fa3d-0cdc-48f5-ba53-291ac1540a27 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.192990 Aug 25 03:21:22.720113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 180/370] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:22 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:23.664705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:23.665282 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:23.671408 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:23.671892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:23.672319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:23.673006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:23.673481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:23.673901 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:23.740296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:23.740959 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:23.747604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:23.748075 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:23.748499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:23.749367 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:23.749814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:23.750233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:23.754842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:23.755552 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:23.763555 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fd92409d-16a7-4241-b16c-b1801bb23ee1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1294 microversion: 2.1 time: 0.103473 Aug 25 03:21:23.764277 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 191/371] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:23 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:23.971278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:23.980154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a584c6a4-8419-4b24-9131-eec0d769a298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.243863 Aug 25 03:21:23.980741 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 181/372] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:23 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:24.785207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:24.786505 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:24.793519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:24.794433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:24.795073 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:24.796680 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:24.797322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:24.797901 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:25.001555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:25.002101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:25.008622 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:25.009194 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:25.009716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:25.010526 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:25.011052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:25.011545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:25.071474 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:25.079625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-867daccb-a69b-43f9-a0de-530e2136544a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.298416 Aug 25 03:21:25.080183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 192/373] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:24 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:25.236498 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:25.244165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7b27061f-065a-41f0-8384-f5bf7e814d13 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.246554 Aug 25 03:21:25.244741 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 182/374] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:24 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:25.549175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-59a63e05-2676-4056-83e8-f268e4000613 req-3f993cc7-3ef1-4eae-93e2-4a208ff4ca96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e412db1-9619-4776-a113-7323c77edc58", "tag": "24ce5711-73e2-4aca-8005-7327565d8aa0"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:25.558944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-59a63e05-2676-4056-83e8-f268e4000613 req-3f993cc7-3ef1-4eae-93e2-4a208ff4ca96 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:25.559423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-59a63e05-2676-4056-83e8-f268e4000613 req-3f993cc7-3ef1-4eae-93e2-4a208ff4ca96 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:25.559849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-59a63e05-2676-4056-83e8-f268e4000613 req-3f993cc7-3ef1-4eae-93e2-4a208ff4ca96 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:25.575330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-59a63e05-2676-4056-83e8-f268e4000613 req-3f993cc7-3ef1-4eae-93e2-4a208ff4ca96 service nova] Creating event network-changed:24ce5711-73e2-4aca-8005-7327565d8aa0 for instance 3e412db1-9619-4776-a113-7323c77edc58 on hv-cinder-85164 Aug 25 03:21:25.580419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-59a63e05-2676-4056-83e8-f268e4000613 req-3f993cc7-3ef1-4eae-93e2-4a208ff4ca96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035323 Aug 25 03:21:25.581649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 193/375] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:21:26.101142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:26.101691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:26.108588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.109071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.109499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:26.110196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.110916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.111340 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:26.261006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:26.268956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c2c96d94-f001-4525-96fd-7dccca31ff22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.171738 Aug 25 03:21:26.269386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:26.270529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:26.280126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.280609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.281994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:26.282878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.283197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 183/376] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:26 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:26.284055 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.285001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:26.506747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:26.514625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f5abf46a-ef50-4cbd-ac6e-6220ac7ea202 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.253093 Aug 25 03:21:26.515199 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 194/377] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:26 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:26.621357 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:26.621853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:26.627941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.628420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.628852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:26.629597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.630060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.630638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:26.657719 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:21:26.917010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e5b1e28c-f7dd-4a54-8663-442ebd785216 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 204 len: 0 microversion: 2.1 time: 0.298998 Aug 25 03:21:26.917612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 184/378] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:21:26 2022] DELETE /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:21:26.926683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:26.927358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:26.929288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:26.929965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=10 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:26.934923 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.935403 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.935836 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:26.936595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:26.936972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:26.937400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:27.076343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:27.084766 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9c0ecc4c-05de-4c94-a787-6ea71e99dee5 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.162047 Aug 25 03:21:27.085368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 195/379] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:26 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:27.290781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:27.291567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:27.293601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:27.299037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:27.299519 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:27.299947 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:27.300649 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:27.301308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:27.301759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:27.438491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:27.447021 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-39fd777e-6d82-4cd9-9c2d-1fad63ecb1b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.161583 Aug 25 03:21:27.447591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 185/380] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:27 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:27.535031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:27.535677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:27.541691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:27.542116 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:27.542585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:27.543268 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:27.543718 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:27.544141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:27.672787 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:27.680975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8e64abc7-2216-438f-ac6c-eb2c85d01e22 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.149806 Aug 25 03:21:27.681548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 196/381] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:27 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:28.105147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:28.105748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:28.112009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:28.112491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:28.112927 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:28.113622 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:28.114065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:28.114536 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:28.255954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:28.264174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f6d65d94-ee7a-441f-8513-98e9d8903fe7 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.162858 Aug 25 03:21:28.264760 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 186/382] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:28 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:28.502599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:28.502599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:28.502599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:28.502599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:28.502935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:28.502935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:28.502935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:28.502935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:28.619376 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:28.627357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f440d866-1c9c-455c-bc23-5769f263eabc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.163488 Aug 25 03:21:28.627956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 197/383] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:28 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:28.702191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:28.702822 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:28.709997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:28.714305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:28.714305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:28.714305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:28.714305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:28.714704 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:28.840894 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:28.848852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b1323297-af6a-4ec7-ab4c-a6f967d28de1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.150729 Aug 25 03:21:28.849425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 187/384] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:28 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:29.284941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:29.286078 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:29.291959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:29.292825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:29.292947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:29.293522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:29.293974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:29.294424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:29.424239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:29.432455 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-437fab20-4785-4000-98eb-0e3e3ebab917 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.151433 Aug 25 03:21:29.433012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 198/385] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:29 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:29.648728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:29.649430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:29.655906 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:29.656431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:29.656864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:29.657716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:29.658164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:29.658609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:29.788703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:29.796275 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-87dfd7a3-d59b-4661-880c-0debee55f229 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.151884 Aug 25 03:21:29.796840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 188/386] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:29 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:29.869747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:29.870450 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:29.880363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:29.880363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:29.880363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:29.880363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:29.880689 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:29.880689 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:30.040413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:30.046221 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:30.048885 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-166ed4fc-e5ef-443c-9479-d50e3fd40463 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.182936 Aug 25 03:21:30.049767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 199/387] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:29 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:30.453257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:30.453864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:30.459764 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:30.461934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:30.461934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:30.461934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:30.461934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:30.462323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:30.598378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:30.607020 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-61cdc3ca-e8c5-402c-a83d-27dfc5bccb58 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.157947 Aug 25 03:21:30.607669 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 189/388] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:30 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:30.816982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:30.817501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:30.819753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:30.824733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:30.825209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:30.825643 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:30.826358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:30.826813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:30.828857 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:30.959120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:30.966719 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d34e015c-081d-434c-8e7a-479107920082 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.153646 Aug 25 03:21:30.967268 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 200/389] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:30 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:31.069490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:31.070027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:31.072327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:31.077186 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:31.077666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:31.078096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:31.078807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:31.079256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:31.079676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:31.214060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:31.221689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-92ed2711-747c-4236-b386-768c2ab89460 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.156717 Aug 25 03:21:31.222548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 190/390] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:31 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:31.628174 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:31.628808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:31.635265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:31.637590 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:31.637590 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:31.637590 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:31.637590 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:31.638625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:31.768656 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:31.777248 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5bd5f1b4-dc09-4fd6-9199-895fdbfd10ce tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.153114 Aug 25 03:21:31.777808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 201/391] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:31 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:31.987140 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:31.987743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:31.994376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:31.994844 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:31.995266 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:31.995942 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:31.996384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:31.996796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:32.125631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:32.133807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-04afb67c-cef1-4722-9f15-0397b61e80b2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.150511 Aug 25 03:21:32.134387 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 191/392] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:31 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:32.243118 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:32.243731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:32.249599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:32.250073 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:32.250537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:32.251215 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:32.251660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:32.252077 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:32.376427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:32.384129 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-94a2d37b-f544-42bf-8e50-b3dc1b51f116 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.145478 Aug 25 03:21:32.384866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 202/393] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:32 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:32.798001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:32.798808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:32.804884 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:32.805361 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:32.805792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:32.806516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:32.806968 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:32.807392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:32.936882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:32.945855 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7d3420d6-420d-4d8c-888a-1eef776e4171 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.151700 Aug 25 03:21:32.946476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 192/394] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:32 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:33.154177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:33.154819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:33.160939 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:33.161536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:33.161971 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:33.162702 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:33.163152 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:33.165068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:33.312141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:33.323073 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-444f96aa-83dd-4858-bf42-e0eabf6598f0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.172696 Aug 25 03:21:33.324027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 203/395] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:33 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:33.404942 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:33.405532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:33.412569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:33.413054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:33.413492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:33.414189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:33.414666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:33.415087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:33.597398 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:33.606183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-98aa4ecd-5239-4aee-9f15-63f21ff92cc7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.205174 Aug 25 03:21:33.634095 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 193/396] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:33 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:33.967925 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:33.968540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:33.974406 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:33.974882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:33.975355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:33.976327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:33.976705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:33.977635 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:34.111624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:34.119881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-be537391-ca78-4e6c-9201-851b28d87d40 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.155869 Aug 25 03:21:34.120446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 204/397] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:33 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:34.247930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-68cbcfa4-06e1-4564-814f-b29bf236ae9d req-29a4779b-d561-4aa9-a816-ad74801f32fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e412db1-9619-4776-a113-7323c77edc58", "name": "network-vif-plugged", "status": "completed", "tag": "24ce5711-73e2-4aca-8005-7327565d8aa0"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:34.259393 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-68cbcfa4-06e1-4564-814f-b29bf236ae9d req-29a4779b-d561-4aa9-a816-ad74801f32fb service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:34.259898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-68cbcfa4-06e1-4564-814f-b29bf236ae9d req-29a4779b-d561-4aa9-a816-ad74801f32fb service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:34.260328 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-68cbcfa4-06e1-4564-814f-b29bf236ae9d req-29a4779b-d561-4aa9-a816-ad74801f32fb service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:34.272663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-68cbcfa4-06e1-4564-814f-b29bf236ae9d req-29a4779b-d561-4aa9-a816-ad74801f32fb service nova] Creating event network-vif-plugged:24ce5711-73e2-4aca-8005-7327565d8aa0 for instance 3e412db1-9619-4776-a113-7323c77edc58 on hv-cinder-85164 Aug 25 03:21:34.277804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-68cbcfa4-06e1-4564-814f-b29bf236ae9d req-29a4779b-d561-4aa9-a816-ad74801f32fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034550 Aug 25 03:21:34.278437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 194/398] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:21:34.349851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:34.350491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:34.356378 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:34.356859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:34.357290 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:34.357979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:34.358540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:34.358942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:34.492081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:34.501442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-be81e9d3-ea6a-4f84-a2bb-1cacb5f9e4b4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.155283 Aug 25 03:21:34.502484 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 205/399] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:34 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:34.644082 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:34.644929 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:34.651196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:34.651682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:34.652117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:34.652808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:34.653255 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:34.653676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:34.794268 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:34.802645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-25558326-ec06-41b7-886f-b0a3574f27ae tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.163689 Aug 25 03:21:34.803509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 195/400] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:34 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:35.141323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:35.146080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:35.148058 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:35.148563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:35.148992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:35.149667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:35.150109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:35.150558 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:35.284068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:35.292269 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-628133a2-4f76-4e62-a92d-4daca372b63e tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.154799 Aug 25 03:21:35.293355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 206/401] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:35 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:35.523535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:35.524083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:35.530135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:35.530650 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:35.531083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:35.531772 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:35.532222 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:35.532645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:35.670872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:35.674420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:35.679364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a84d9ef2-5e69-4731-b1e7-5e1b4780812d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.159783 Aug 25 03:21:35.679934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 196/402] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:35 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:35.825001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:35.825605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:35.831518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:35.831999 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:35.832433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:35.833120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:35.833570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:35.833992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:35.967693 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:35.975493 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5bcc03f6-e3a0-4ce6-8abc-fed98f216570 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.154547 Aug 25 03:21:35.976561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 207/403] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:35 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:36.313107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:36.313733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:36.320644 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:36.321111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:36.321536 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:36.322209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:36.322681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:36.323093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:36.473706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:36.482608 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9f1feefa-299d-43cd-a465-ca15fede89b6 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.173466 Aug 25 03:21:36.483182 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 197/404] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:36 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:36.701178 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:36.701351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:36.709375 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:36.709856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:36.710905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:36.711605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:36.712059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:36.712478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:36.862584 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:36.870189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4ea0c81e-62fd-4036-80b5-48d711fb26a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.173734 Aug 25 03:21:36.870776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 208/405] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:36 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:36.996182 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:36.996777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:37.003321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:37.003880 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:37.004389 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:37.005158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:37.005703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:37.006199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:37.141101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:37.148841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4dcc7c3b-38d7-476b-aa72-af9917c9b5fe tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.156485 Aug 25 03:21:37.149411 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 198/406] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:36 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:37.503919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:37.504591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:37.510634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:37.511104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:37.511527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:37.512247 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:37.512685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:37.518479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:37.646302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:37.655811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-534ba5d9-f215-47fc-a1d8-13343ace15fb tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.155859 Aug 25 03:21:37.656569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 209/407] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:37 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:37.891571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:37.892110 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:37.898651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:37.899123 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:37.899551 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:37.900232 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:37.900678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:37.901097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:38.032249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:38.040846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6c653ee3-663d-4172-adf4-5fd387454a32 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.153011 Aug 25 03:21:38.041157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 199/408] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:37 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:38.168976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:38.169588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:38.175551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:38.176031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:38.176465 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:38.183241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:38.183241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:38.183241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:38.304668 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:38.312449 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-87c343e9-01bc-4177-97ed-e74faed2bf08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.147388 Aug 25 03:21:38.313173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 210/409] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:38 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:38.678235 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:38.679516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:38.686062 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:38.686601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:38.687034 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:38.687737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:38.695470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:38.695470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:38.703761 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-20cca756-96df-45d2-bf1c-76beaa8577ad req-3596a7b3-9c90-4e9b-9c69-90b363a2bc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8341fa7-ed5e-478a-9690-5805508c0885", "name": "network-vif-unplugged", "status": "completed", "tag": "8abb62c9-8848-4a81-846c-6dc081d63ee8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:38.715217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-20cca756-96df-45d2-bf1c-76beaa8577ad req-3596a7b3-9c90-4e9b-9c69-90b363a2bc45 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:38.715800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-20cca756-96df-45d2-bf1c-76beaa8577ad req-3596a7b3-9c90-4e9b-9c69-90b363a2bc45 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:38.716593 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-20cca756-96df-45d2-bf1c-76beaa8577ad req-3596a7b3-9c90-4e9b-9c69-90b363a2bc45 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:38.729854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-20cca756-96df-45d2-bf1c-76beaa8577ad req-3596a7b3-9c90-4e9b-9c69-90b363a2bc45 service nova] Creating event network-vif-unplugged:8abb62c9-8848-4a81-846c-6dc081d63ee8 for instance c8341fa7-ed5e-478a-9690-5805508c0885 on hv-cinder-85164 Aug 25 03:21:38.737510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-20cca756-96df-45d2-bf1c-76beaa8577ad req-3596a7b3-9c90-4e9b-9c69-90b363a2bc45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038092 Aug 25 03:21:38.738310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 211/410] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:21:38.839091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:38.848032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9e88474d-5b45-4248-bac1-5f7d3a354002 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.173871 Aug 25 03:21:38.848631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 200/411] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:38 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:39.061740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:39.062534 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:39.068546 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:39.069027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:39.069491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:39.071346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:39.071346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:39.071346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:39.213504 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:39.221241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8d461992-4082-4382-939a-4dfb8cd60a04 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.163770 Aug 25 03:21:39.221818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 212/412] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:39 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:39.334339 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:39.335533 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:39.341969 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:39.342491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:39.342928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:39.343618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:39.344068 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:39.344490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:39.486553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:39.494729 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1e34e3a3-1c58-4b0b-8c7e-ca970475f426 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.164181 Aug 25 03:21:39.497046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 201/413] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:39 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:39.871794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:39.872313 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:39.878308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:39.878794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:39.883186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:39.883186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:39.883186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:39.883186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:40.011640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:40.019232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-db0fd6a4-8888-40d9-9e45-4a96539303c0 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1502 microversion: 2.1 time: 0.151346 Aug 25 03:21:40.019807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 213/414] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:39 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:40.242930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:40.243533 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:40.249452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:40.249952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:40.250422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:40.251107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:40.251555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:40.251976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:40.378812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:40.386789 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-243dac97-da9c-4133-9c78-224b388657b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.147698 Aug 25 03:21:40.387350 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 202/415] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:40 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:40.517316 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:40.517857 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:40.524387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:40.524830 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:40.525480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:40.526235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:40.527015 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:40.527691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:40.784969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:40.793618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d672906f-43ca-4653-a0bb-395c96b9ba39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.280504 Aug 25 03:21:40.794586 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 214/416] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:40 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:41.044241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:41.044241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:41.055383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:41.056073 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:41.056510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:41.056809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-125b3dd4-04f5-41df-adc3-eee9b8642529 req-3521c6e9-3777-4194-ae1f-95a5f74e3947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8341fa7-ed5e-478a-9690-5805508c0885", "name": "network-vif-deleted", "tag": "8abb62c9-8848-4a81-846c-6dc081d63ee8"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:41.057211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:41.057665 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:41.058093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:41.066985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-125b3dd4-04f5-41df-adc3-eee9b8642529 req-3521c6e9-3777-4194-ae1f-95a5f74e3947 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:41.067459 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-125b3dd4-04f5-41df-adc3-eee9b8642529 req-3521c6e9-3777-4194-ae1f-95a5f74e3947 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:41.067896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-125b3dd4-04f5-41df-adc3-eee9b8642529 req-3521c6e9-3777-4194-ae1f-95a5f74e3947 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:41.079569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-125b3dd4-04f5-41df-adc3-eee9b8642529 req-3521c6e9-3777-4194-ae1f-95a5f74e3947 service nova] Creating event network-vif-deleted:8abb62c9-8848-4a81-846c-6dc081d63ee8 for instance c8341fa7-ed5e-478a-9690-5805508c0885 on hv-cinder-85164 Aug 25 03:21:41.084571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-125b3dd4-04f5-41df-adc3-eee9b8642529 req-3521c6e9-3777-4194-ae1f-95a5f74e3947 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031350 Aug 25 03:21:41.085675 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 215/417] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:21:41.130913 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:41.139261 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-660af6a2-2d38-4727-a08e-35226268dcda tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1460 microversion: 2.1 time: 0.102578 Aug 25 03:21:41.139833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 203/418] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:41 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1460 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:41.408925 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:41.409815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:41.416896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:41.417378 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:41.417809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:41.418536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:41.418992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:41.419392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:41.576606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:41.584474 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a199b48e-f262-42b6-91ca-91c3201fe6bd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.179896 Aug 25 03:21:41.585296 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 216/419] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:41 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:41.816458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:41.817063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:41.824522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:41.824998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:41.825424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:41.826105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:41.826575 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:41.827026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:41.960058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:41.967787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e34ee15e-92f9-4d5b-938a-d28a8483d39f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.155679 Aug 25 03:21:41.968359 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 204/420] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:41 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:42.161022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:42.161635 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:42.172043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:42.175526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:42.175526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:42.175526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:42.175526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:42.175873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:42.205927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:42.206452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:42.206883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:42.207319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lazy-loading 'fault' on Instance uuid c8341fa7-ed5e-478a-9690-5805508c0885 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:21:42.210229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:42.248137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:42.257245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d6387561-42c0-48bd-9ebb-2190aaf226b1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1303 microversion: 2.1 time: 0.099996 Aug 25 03:21:42.257828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 217/421] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:42 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:42.606128 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:42.606766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:42.612866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:42.613336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:42.613768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:42.614501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:42.614954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:42.615378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:42.798998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:42.808163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aea26ec7-bcc4-4df5-9ffa-c9619308df31 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.206166 Aug 25 03:21:42.808753 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 205/422] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:42 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:42.989521 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:42.990133 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:42.996889 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:42.997374 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:42.997812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:42.998564 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:42.999018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:42.999446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.148263 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:43.163639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7db31b33-1ecc-4d3b-9bf4-08a4a02d41e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1502 microversion: 2.1 time: 0.178095 Aug 25 03:21:43.164234 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 218/423] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:42 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:43.185850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdd9acbd-9aa9-4757-8c13-c3f173aad588"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:43.188918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:43.196002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.196488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.196922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.197613 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.198096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.198560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.221559 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] HTTP exception thrown: Cannot 'attach_volume' instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 while it is in vm_state rescued Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Request method failure captured: Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: POST /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0/os-volume_attachments HTTP/1.1 Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 74 Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuokvio5MAixDZYM2euCbL_fTjJk82CeD55b7xEUH87akmz6n46pEBabt24-P2Sd-52Y9x0Y-c2jIfTMrW6wstMY4aBYnbVx9GD_UJWoSemlxT_0P_efCgouKwRgI-lOkTvYmIQWkUrAwYwO2Yk9h4StfingqGT4FXZ_BEKqDvGKCNo Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:21:43.225724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d0928e519ec247b988a254d7918cbfed"}]}] Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: c7dc5019b26a4a8abf6436be3f1e56af Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {"volumeAttachment": {"volumeId": "cdd9acbd-9aa9-4757-8c13-c3f173aad588"}} Aug 25 03:21:43.227374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Cannot 'attach_volume' instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 while it is in vm_state rescued Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'server_id': 'ccfd9dce-16ff-4644-a35d-aadaad1fb6e0', 'body': {'volumeAttachment': {'volumeId': 'cdd9acbd-9aa9-4757-8c13-c3f173aad588'}}} Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:21:43.228148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 while it is in vm_state rescued Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:21:43.229282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:21:43.230424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:21:43.230424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:21:43.230424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 while it is in vm_state rescued Aug 25 03:21:43.230424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:43.230424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Returning 409 to user: Cannot 'attach_volume' instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 while it is in vm_state rescued {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:21:43.230424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-26b54f17-65fc-4e33-abab-594f880512b0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045506 Aug 25 03:21:43.230424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 206/424] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:21:43 2022] POST /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 03:21:43.236366 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:43.236900 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:43.243354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.243878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.244316 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.245003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.245454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.245909 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.278380 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:43.278986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:43.285491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.285988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.286630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.287563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.288178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.288612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.322349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.322825 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.323257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.323705 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lazy-loading 'fault' on Instance uuid c8341fa7-ed5e-478a-9690-5805508c0885 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:21:43.363400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:43.371629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-94a8cfe3-1399-4df5-9aa8-26a374c0f33b tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1303 microversion: 2.1 time: 0.097305 Aug 25 03:21:43.372189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 207/425] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:43 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:43.480853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-01d573fa-2a89-4854-a865-7a09c6a97d84 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0/action" status: 202 len: 0 microversion: 2.1 time: 0.247859 Aug 25 03:21:43.481865 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 219/426] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:21:43 2022] POST /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:21:43.490051 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:43.496632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:43.498916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.499406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.500007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.501268 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.501999 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.502592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.651544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:43.669021 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-addc2286-f5f2-4265-91df-ac0e83505651 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1510 microversion: 2.1 time: 0.182729 Aug 25 03:21:43.682488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 208/427] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:43 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:43.830390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:43.831114 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:43.837671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.838184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.838636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.839308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:43.839751 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:43.840165 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:43.971240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:43.979541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a066dc3c-a11c-4e57-8c17-73e601487614 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1367 microversion: 2.1 time: 0.153725 Aug 25 03:21:43.980109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 220/428] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:43 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:44.392973 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:44.393588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:44.400251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:44.400747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:44.401176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:44.401858 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:44.402328 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:44.402754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:44.432025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:44.432501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:44.432931 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:44.433372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lazy-loading 'fault' on Instance uuid c8341fa7-ed5e-478a-9690-5805508c0885 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:21:44.474164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2552825edca0418392f877ea9488e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882db843d4644ac29365868d1deb9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:44.482072 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-08199038-ba66-4516-99ad-3547aa22a25d tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 200 len: 1303 microversion: 2.1 time: 0.092887 Aug 25 03:21:44.482690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 209/429] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:44 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:44.695914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:44.697651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:44.706375 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:44.707585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:44.708296 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:44.709006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:44.709455 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:44.710046 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:44.940595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:44.949535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fa01237e-6712-4979-915a-a172f24f1c12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1510 microversion: 2.1 time: 0.260229 Aug 25 03:21:44.950393 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 221/430] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:44 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:45.000988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:45.002003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:45.008099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.008639 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.009065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:45.009756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.010202 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.010641 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:45.216233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:45.224726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fa942ea5-1703-4ef9-a1db-60246a6c4621 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1557 microversion: 2.1 time: 0.227620 Aug 25 03:21:45.226008 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 210/431] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:44 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:45.253974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:45.254586 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:45.261095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.261575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.262015 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:45.262739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.263193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.263831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:45.348908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c1bb0ab5-e8e6-4dd3-b3d1-bad18dde7853 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099335 Aug 25 03:21:45.349953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 222/432] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:21:45 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:21:45.502929 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:45.504247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] [instance: c8341fa7-ed5e-478a-9690-5805508c0885] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:45.511533 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.512016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.512447 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:45.513417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.513878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.514307 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:45.529118 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] HTTP exception thrown: Instance c8341fa7-ed5e-478a-9690-5805508c0885 could not be found. Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Request method failure captured: Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 HTTP/1.1 Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBupi2_H0I19ck8N5EjDjPpQleH75_ABd9GpLB210ATkGpJirKFdWVMWgEUHc0BJHSlVj1UEQDoJd8cgmOCF3Ahr1cZp5fo_fi9fgeyGkGEx3ePeAiP2sLm6jS5EE4UNtLaLJHCw_u7BKDv8LjN67kSvRZCP6xSqZs29vSv6ucJb_v_o Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 882db843d4644ac29365868d1deb9a27 Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesActionsTest-1249660405 Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:21:45.531349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/882db843d4644ac29365868d1deb9a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/882db843d4644ac29365868d1deb9a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/882db843d4644ac29365868d1deb9a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_882db843d4644ac29365868d1deb9a27"}]}] Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesActionsTest-1249660405 Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 882db843d4644ac29365868d1deb9a27 Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesActionsTest-1249660405 Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesActionsTest-1249660405-project Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 2552825edca0418392f877ea9488e36f Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesActionsTest-1249660405-project Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance c8341fa7-ed5e-478a-9690-5805508c0885 could not be found. Aug 25 03:21:45.532643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'c8341fa7-ed5e-478a-9690-5805508c0885'} Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8341fa7-ed5e-478a-9690-5805508c0885 could not be found. Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:21:45.533364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8341fa7-ed5e-478a-9690-5805508c0885 could not be found. Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8341fa7-ed5e-478a-9690-5805508c0885 could not be found. Aug 25 03:21:45.534516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:21:45.535803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] Returning 404 to user: Instance c8341fa7-ed5e-478a-9690-5805508c0885 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:21:45.535803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0150d1b2-63fc-4638-9998-eb4d17d95eb1 tempest-VolumesActionsTest-1249660405 tempest-VolumesActionsTest-1249660405-project] 10.222.0.58 "GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885" status: 404 len: 111 microversion: 2.1 time: 0.034873 Aug 25 03:21:45.541761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 211/433] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:45 2022] GET /compute/v2.1/servers/c8341fa7-ed5e-478a-9690-5805508c0885 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:21:45.971060 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:45.971731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:45.981711 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.982197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.982658 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:45.983354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:45.983808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:45.984249 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:46.187289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:46.197560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ad1da0ab-7342-4500-b77a-df18e7e483d3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1510 microversion: 2.1 time: 0.229691 Aug 25 03:21:46.210387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 223/434] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:45 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:46.867803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-9a32f9f7-1c93-4efb-b87e-55af0dd82272 req-d676d8f2-6691-4694-810a-a4b1365fa4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e412db1-9619-4776-a113-7323c77edc58", "tag": "24ce5711-73e2-4aca-8005-7327565d8aa0"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:46.879177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9a32f9f7-1c93-4efb-b87e-55af0dd82272 req-d676d8f2-6691-4694-810a-a4b1365fa4ab service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:46.884433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9a32f9f7-1c93-4efb-b87e-55af0dd82272 req-d676d8f2-6691-4694-810a-a4b1365fa4ab service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:46.884433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9a32f9f7-1c93-4efb-b87e-55af0dd82272 req-d676d8f2-6691-4694-810a-a4b1365fa4ab service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:46.895081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-9a32f9f7-1c93-4efb-b87e-55af0dd82272 req-d676d8f2-6691-4694-810a-a4b1365fa4ab service nova] Creating event network-changed:24ce5711-73e2-4aca-8005-7327565d8aa0 for instance 3e412db1-9619-4776-a113-7323c77edc58 on hv-cinder-85164 Aug 25 03:21:46.900375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-9a32f9f7-1c93-4efb-b87e-55af0dd82272 req-d676d8f2-6691-4694-810a-a4b1365fa4ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036713 Aug 25 03:21:46.907514 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 212/435] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:21:47.220184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:47.221787 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:47.231010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:47.232117 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:47.232722 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:47.233600 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:47.234259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:47.234715 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:47.387383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:47.398212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-698eee1b-bcbf-4daf-a02a-05d2fe6e098b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1510 microversion: 2.1 time: 0.179845 Aug 25 03:21:47.402852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 224/436] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:47 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:48.416810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:48.417629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:48.423697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:48.424105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:48.424528 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:48.425205 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:48.425646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:48.426057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:48.568025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:48.576651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1c304838-a95a-48a6-868d-68f2e911d2cc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1516 microversion: 2.1 time: 0.164574 Aug 25 03:21:48.577252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 213/437] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:48 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:58.856097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b2412e2-4c6d-4005-b5ab-4ade98c901fb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'create', calling method: .version_select at 0x7fa33a89fa60>, body: {"keypair": {"name": "tempest-keypair-441783100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZK8jc7wf76KHL8nIBn/QzRqKBt3XKiFHMoGLdaArXQ9ky7kJoevQhlMaXxKSaOwG0VBYkwjYrrANNkwpsxYK02tBwvBtQW+dS954mV6xnQHEtzE4fGVhUVKzG/8fwbwg=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:58.872681 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=51 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:58.876434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:58.908144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-6b2412e2-4c6d-4005-b5ab-4ade98c901fb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for project d0928e519ec247b988a254d7918cbfed. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:21:58.910597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-6b2412e2-4c6d-4005-b5ab-4ade98c901fb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for user c7dc5019b26a4a8abf6436be3f1e56af and project d0928e519ec247b988a254d7918cbfed. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:21:59.027518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b2412e2-4c6d-4005-b5ab-4ade98c901fb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176988 Aug 25 03:21:59.029032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 225/438] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:21:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:22:03.711887 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1037702868", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fdf63ec-44a0-4852-85a8-eedf09ade4f7"}], "security_groups": [{"name": "tempest-securitygroup--864888277"}], "key_name": "tempest-keypair-441783100", "user_data": "}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:22:03.730142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=51 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:03.731547 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=96 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:03.860734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] validate_networks() for [('1fdf63ec-44a0-4852-85a8-eedf09ade4f7', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:22:04.513195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:22:04.514139 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:22:04.515117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:22:04.515985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:22:04.517007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:22:04.534865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:04.535726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:04.536577 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:04.537643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:04.538490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:04.539100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:04.574788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for project d0928e519ec247b988a254d7918cbfed. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:22:04.580687 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Getting quotas for user c7dc5019b26a4a8abf6436be3f1e56af and project d0928e519ec247b988a254d7918cbfed. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:22:04.593962 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:22:04.597225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:22:04.752458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e2e23c10-0ef2-4e80-9df1-108465bded66 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.046675 Aug 25 03:22:04.757886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 214/439] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:22:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:22:04.770398 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-00bbcd46-69c1-4062-896e-784678fc107f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:04.770398 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-00bbcd46-69c1-4062-896e-784678fc107f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:04.920111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-00bbcd46-69c1-4062-896e-784678fc107f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:04.940076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-00bbcd46-69c1-4062-896e-784678fc107f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1245 microversion: 2.1 time: 0.175364 Aug 25 03:22:04.945976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 226/440] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:04 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1245 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:05.966751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c2f5ee49-a989-432e-8960-009ab41549dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:05.967972 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c2f5ee49-a989-432e-8960-009ab41549dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:06.093009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c2f5ee49-a989-432e-8960-009ab41549dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:06.103697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c2f5ee49-a989-432e-8960-009ab41549dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1245 microversion: 2.1 time: 0.141480 Aug 25 03:22:06.104378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 215/441] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:05 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1245 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:07.127945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:07.128610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:07.139809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:07.140352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:07.140788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:07.141483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:07.144967 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:07.147009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:07.251138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:07.267150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1884d8c7-a054-4573-bb0f-7c9fdd4c13a9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1241 microversion: 2.1 time: 0.144406 Aug 25 03:22:07.268013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 216/442] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:07 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1241 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:07.591746 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8f551d79-b6a3-45d3-b989-0aee9a6729a4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Action: 'create', calling method: .version_select at 0x7fa33bf57f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-906870696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDswWMeKG62ZsU8/0hex/imlhQX5Muq2Qu9Pu6NpeJ24qzoVNtlqQJk0jOJ5mXnccUVYCCk6CAHOvznpoFGvifvLdX3V5Ya+4LcglaX3RagzPKza6ntbQ9hkRvFrP1jyeg=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:22:07.626843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-8f551d79-b6a3-45d3-b989-0aee9a6729a4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for project 5d445535a4974186a835ab117109dca1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:22:07.640795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-8f551d79-b6a3-45d3-b989-0aee9a6729a4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for user d0a0e9c327564a3db8b89ea706f0fb36 and project 5d445535a4974186a835ab117109dca1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:22:07.738146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8f551d79-b6a3-45d3-b989-0aee9a6729a4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.633577 Aug 25 03:22:07.738770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 227/443] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:22:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:22:08.304383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:08.304383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:08.323618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:08.324117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:08.324555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:08.325282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:08.325742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:08.326171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:08.622509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:08.631730 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-95e89185-0c81-40a5-9ec0-0a629b803298 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1305 microversion: 2.1 time: 0.345856 Aug 25 03:22:08.635247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 217/444] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:08 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1305 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:09.663752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:09.665871 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:09.675423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:09.678877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:09.679617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:09.680721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:09.681467 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:09.682044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:10.135277 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:10.158482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-12e44b44-deca-4c80-9a4d-7b1bb765b313 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.490713 Aug 25 03:22:10.173508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 228/445] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:09 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:11.054665 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-7feebcf3-190b-418e-afa1-3c2db6c661da req-c45a1c03-f21a-49f9-b5eb-428f6bff38f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e2d76b-15ac-4d15-bd62-9835364dabc3", "tag": "c45badac-76ed-40f5-ace2-d566d6e55505"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:22:11.083935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7feebcf3-190b-418e-afa1-3c2db6c661da req-c45a1c03-f21a-49f9-b5eb-428f6bff38f5 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:11.084432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7feebcf3-190b-418e-afa1-3c2db6c661da req-c45a1c03-f21a-49f9-b5eb-428f6bff38f5 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:11.084933 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7feebcf3-190b-418e-afa1-3c2db6c661da req-c45a1c03-f21a-49f9-b5eb-428f6bff38f5 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:11.103718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-7feebcf3-190b-418e-afa1-3c2db6c661da req-c45a1c03-f21a-49f9-b5eb-428f6bff38f5 service nova] Creating event network-changed:c45badac-76ed-40f5-ace2-d566d6e55505 for instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 on hv-cinder-85164 Aug 25 03:22:11.115575 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-7feebcf3-190b-418e-afa1-3c2db6c661da req-c45a1c03-f21a-49f9-b5eb-428f6bff38f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069509 Aug 25 03:22:11.118718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 218/446] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:22:11.182068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:11.185755 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:11.196156 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:11.197110 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:11.198668 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:11.199859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:11.200517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:11.201162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:11.982675 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:11.995374 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0657c34f-bc2b-4ced-a794-ab134e2fa294 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.819046 Aug 25 03:22:11.999815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 229/447] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:11 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:13.017436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:13.019052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:13.029896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:13.031191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:13.031876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:13.032945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:13.033657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:13.034158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:13.214363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:13.222831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a96b20d1-fb61-4e5e-8742-d841349d9d41 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.210300 Aug 25 03:22:13.223419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 219/448] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:13 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:14.244004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:14.245310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:14.251624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:14.252100 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:14.252733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:14.253633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:14.254271 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:14.255483 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:14.437424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:14.447179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-204d98e0-9d8c-46bd-8222-2d08c54c7058 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.207057 Aug 25 03:22:14.448982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 230/449] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:14 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:15.473193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:15.474883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:15.479930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:15.484636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:15.485466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:15.490806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:15.490806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:15.490806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:15.490806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:15.651646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:15.660104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d4e771d6-d686-4486-bce0-a03bb86cc185 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.193339 Aug 25 03:22:15.661682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 220/450] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:15 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:16.688445 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:16.690306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:16.706568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:16.706568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:16.706568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:16.706568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:16.707010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:16.707010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:16.910778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:16.923007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a5ce99c5-c3f4-4754-b93f-3b20dd8b2da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.244364 Aug 25 03:22:16.926438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 231/451] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:16 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:17.950158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:17.950905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:17.953038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=8 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:17.959022 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:17.959571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:17.960122 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:17.960817 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:17.961270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:17.961722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:18.091970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:18.100416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b96972fe-7808-430c-b2b1-a6f8d7e3006c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.154708 Aug 25 03:22:18.106151 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 221/452] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:17 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:19.123700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:19.124638 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:19.128863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=10 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:19.134832 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:19.135592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:19.136253 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:19.137315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:19.138007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:19.138687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:19.281018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:19.288683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ae6bf67b-29a3-41c7-88a4-d60b76a0343f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.171123 Aug 25 03:22:19.289246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 232/453] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:19 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:20.309163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:20.312450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:20.316309 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:20.316786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:20.317247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:20.318083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:20.318558 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:20.318983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:20.461400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:20.469733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5fd55534-e1c3-4860-abe9-9bac8787fe7d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.164515 Aug 25 03:22:20.470364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 222/454] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:20 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:21.492533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:21.493235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:21.510475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:21.510983 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:21.511575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:21.512276 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:21.512784 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:21.514326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:21.662525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:21.670202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ff18c596-977f-4d71-a44a-24a011ee56c9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.182639 Aug 25 03:22:21.670806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 233/455] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:21 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:22.690786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:22.692183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:22.699249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:22.700049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:22.700573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:22.701505 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:22.702053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:22.702721 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:22.849428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:22.861377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d5cde2aa-7d99-4bbe-b100-1bc751c6dd8b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.174557 Aug 25 03:22:22.862274 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 223/456] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:22 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:23.884132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:23.884777 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:23.890725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:23.891207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:23.891635 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:23.892324 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:23.892776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:23.893199 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:24.022456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:24.030060 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5ea9dc54-c5c2-4c2e-8f6b-e971369e8ed6 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.150545 Aug 25 03:22:24.030656 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 234/457] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:23 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:25.050519 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:25.051113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:25.057513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:25.057988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:25.058457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:25.059144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:25.059595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:25.060016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:25.187957 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:25.195576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f4cb3998-d062-43cd-a980-4344e306a862 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.148985 Aug 25 03:22:25.196145 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 224/458] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:25 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:26.218371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:26.223603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:26.225598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:26.226075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:26.226543 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:26.227226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:26.227678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:26.228097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:26.359870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:26.368167 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6238b34a-8d31-4146-869d-00116acb1425 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.153776 Aug 25 03:22:26.368735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 235/459] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:26 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:27.388835 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:27.389581 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:27.396271 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:27.396763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:27.397186 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:27.397874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:27.398382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:27.398809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:27.525902 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:27.533654 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e3728adb-aac6-4f08-9f26-ec4789dfe8b1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.148792 Aug 25 03:22:27.534213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 225/460] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:27 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:28.554154 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:28.554834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:28.560989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:28.561467 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:28.561896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:28.562620 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:28.563072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:28.563496 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:28.709032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:28.716714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2a01817b-44cc-43ef-9caf-eeeb849dc4f0 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.166358 Aug 25 03:22:28.717286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 236/461] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:28 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:29.740534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:29.741227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:29.747664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:29.748225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:29.748771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:29.749344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:29.749793 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:29.750213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:29.885390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:29.893770 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ed254051-6e1c-4ad8-9678-480de2ba50a3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.157287 Aug 25 03:22:29.894420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 226/462] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:29 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:30.914908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:30.915525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:30.921598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:30.922075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:30.922544 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:30.923232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:30.923686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:30.924111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:31.058217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:31.066603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3ceb66f5-227e-482f-9e36-72740d62348f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.155946 Aug 25 03:22:31.067197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 237/463] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:30 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:32.087401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:32.087998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:32.094370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:32.094842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:32.095268 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:32.095940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:32.096382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:32.096796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:32.230852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:32.239628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c3f26ccf-2fe8-4052-99ef-2706837f634f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.155449 Aug 25 03:22:32.240644 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 227/464] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:32 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:22:33.263317 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:33.264042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:33.272667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:33.273151 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:33.273583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:33.274307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:33.274764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:33.275184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:33.410263 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:33.418609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e05e898c-86c5-46d2-a7fa-767a1ba3fe63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.159151 Aug 25 03:22:33.419117 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 238/465] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:33 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:34.439064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:34.439671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:34.441945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:34.446827 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:34.447304 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:34.447785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:34.448425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:34.448869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:34.449300 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:34.453174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=71 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:34.577550 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:34.585197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-27f1c234-80d6-4058-a980-78be749c38ff tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.149903 Aug 25 03:22:34.585769 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 228/466] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:34 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:35.604910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:35.605522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:35.613216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:35.613216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:35.613216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:35.613216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:35.613647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:35.614622 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:35.615044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:35.741138 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:35.748877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9d584f9d-dd2b-4594-b889-cb4de78e60d4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.147887 Aug 25 03:22:35.749437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 239/467] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:35 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:36.769746 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:36.770382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:36.777495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:36.778016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:36.778493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:36.779368 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:36.779826 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:36.780252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:36.915078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:36.923317 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-20bfa9c2-f465-4fcc-b7a0-8d834e28630d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.157509 Aug 25 03:22:36.923890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 229/468] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:36 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:37.708337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-fc2a2442-a637-4e17-aa90-9006c099313f req-057991e9-cb9f-4263-b1e5-a1432f3c76da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e2d76b-15ac-4d15-bd62-9835364dabc3", "name": "network-vif-plugged", "status": "completed", "tag": "c45badac-76ed-40f5-ace2-d566d6e55505"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:22:37.719907 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fc2a2442-a637-4e17-aa90-9006c099313f req-057991e9-cb9f-4263-b1e5-a1432f3c76da service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:37.720379 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fc2a2442-a637-4e17-aa90-9006c099313f req-057991e9-cb9f-4263-b1e5-a1432f3c76da service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:37.720815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fc2a2442-a637-4e17-aa90-9006c099313f req-057991e9-cb9f-4263-b1e5-a1432f3c76da service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:37.723418 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=73 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:22:37.733762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-fc2a2442-a637-4e17-aa90-9006c099313f req-057991e9-cb9f-4263-b1e5-a1432f3c76da service nova] Creating event network-vif-plugged:c45badac-76ed-40f5-ace2-d566d6e55505 for instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 on hv-cinder-85164 Aug 25 03:22:37.740579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-fc2a2442-a637-4e17-aa90-9006c099313f req-057991e9-cb9f-4263-b1e5-a1432f3c76da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038324 Aug 25 03:22:37.741527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 240/469] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:22:37.945701 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:37.946591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:37.953703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:37.954182 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:37.954638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:37.955498 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:37.955909 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:37.956329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:38.107306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:38.114081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8dce8de6-87ee-4f11-a30d-2c2d80b291dc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.172515 Aug 25 03:22:38.114737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 230/470] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:37 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:39.136324 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:39.137191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:39.143513 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:39.143993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:39.144437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:39.145125 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:39.145582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:39.146027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:39.278993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:39.287199 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d830337e-613d-4f9e-be04-518b1aaec772 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.155455 Aug 25 03:22:39.287748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 241/471] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:39 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:40.311290 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:40.311933 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:40.320205 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:40.320684 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:40.321114 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:40.322109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:40.322580 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:40.323008 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:40.457437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:40.465037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ecff0562-65a2-465b-ad96-13324b944a1e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.157814 Aug 25 03:22:40.465604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 231/472] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:40 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:41.485799 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:41.486454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:41.492905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:41.493382 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:41.493811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:41.494532 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:41.494981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:41.495400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:41.626604 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:41.634846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b45666da-2ee2-46b0-81dc-b8506a5e279a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.152858 Aug 25 03:22:41.635411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 242/473] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:41 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:42.655154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:42.655768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:42.662175 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:42.662737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:42.663180 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:42.663876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:42.664330 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:42.664754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:42.795014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:42.802542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f706c714-a31f-4dc5-806c-46e7374144c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.151248 Aug 25 03:22:42.803117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 232/474] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:42 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:43.825208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:43.825810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:43.832825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:43.833302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:43.833888 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:43.834618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:43.835064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:43.835634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:44.022541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:44.033145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ce83f8f5-dda1-4c7d-bbd7-eb5ee69a2a10 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.212021 Aug 25 03:22:44.046477 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 243/475] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:43 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:45.055584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:45.056192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:45.062199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:45.062707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:45.063141 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:45.063861 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:45.064309 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:45.064730 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:45.190630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:45.198871 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-66f1e08a-2db7-4520-9855-cfdf0ccd0986 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.147359 Aug 25 03:22:45.199439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 233/476] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:45 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:46.220121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:46.220725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:46.227347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:46.227820 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:46.228245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:46.228957 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:46.234651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:46.234651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:46.361005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:46.368687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f7378998-bd48-4529-89f3-32d10dae0b63 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.152487 Aug 25 03:22:46.369251 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 244/477] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:46 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:47.391825 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:47.392429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:47.399132 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:47.399610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:47.400041 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:47.400730 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:47.401173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:47.401591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:47.532456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:47.539939 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ca7aaa85-59dd-44a5-be72-b99c3b52244e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.153369 Aug 25 03:22:47.540502 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 234/478] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:47 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:48.570674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:48.570674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:48.570674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:48.570674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:48.571687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:48.571687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:48.571687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:48.571687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:48.699983 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:48.707619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b2b30fbe-884b-485e-87e5-15ba197cdecc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1370 microversion: 2.1 time: 0.150491 Aug 25 03:22:48.708205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 245/479] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:48 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:49.729109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:49.729637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:49.736459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:49.737009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:49.737445 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:49.738135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:49.738619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:49.739043 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:49.875212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:22:49.883570 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c362fd47-37d9-4384-8c74-8a4b52e52adc tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1564 microversion: 2.1 time: 0.157904 Aug 25 03:22:49.888524 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 235/480] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:22:49 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:22:49.904318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:22:49.909078 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:22:49.912977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:49.913454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:49.914545 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:49.915237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:49.915687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:49.916104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:49.994806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0bae99f4-daa9-4d42-866d-e817215f911a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094038 Aug 25 03:22:49.995411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 246/481] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:22:49 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:22:51.625110 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-f0c78896-b3e9-4649-a462-e163ab065cab req-1b1359c5-2f25-40e2-adab-ed61912b5d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e2d76b-15ac-4d15-bd62-9835364dabc3", "tag": "c45badac-76ed-40f5-ace2-d566d6e55505"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:22:51.637200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f0c78896-b3e9-4649-a462-e163ab065cab req-1b1359c5-2f25-40e2-adab-ed61912b5d2d service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:22:51.637200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f0c78896-b3e9-4649-a462-e163ab065cab req-1b1359c5-2f25-40e2-adab-ed61912b5d2d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:22:51.637200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f0c78896-b3e9-4649-a462-e163ab065cab req-1b1359c5-2f25-40e2-adab-ed61912b5d2d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:22:51.648429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-f0c78896-b3e9-4649-a462-e163ab065cab req-1b1359c5-2f25-40e2-adab-ed61912b5d2d service nova] Creating event network-changed:c45badac-76ed-40f5-ace2-d566d6e55505 for instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 on hv-cinder-85164 Aug 25 03:22:51.653486 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-f0c78896-b3e9-4649-a462-e163ab065cab req-1b1359c5-2f25-40e2-adab-ed61912b5d2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031876 Aug 25 03:22:51.654153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 236/482] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:05.517971 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=15 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:05.518796 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=35 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:05.522632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1623972604", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-906870696", "security_groups": [{"name": "tempest-secgroup-smoke-124869442"}], "block_device_mapping_v2": [{"uuid": "666511fc-dcaf-4302-b780-d5a3893f2512", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "444723d5-7c16-4c26-8712-31f648699b2b"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:05.644016 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] validate_networks() for [('444723d5-7c16-4c26-8712-31f648699b2b', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:23:06.027845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:23:06.028331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:23:06.028819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:23:06.029224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:23:06.029633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:23:06.038933 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:06.039411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:06.040481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:06.041210 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:06.041731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:06.042209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:06.060118 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for project 5d445535a4974186a835ab117109dca1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:23:06.064047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for user d0a0e9c327564a3db8b89ea706f0fb36 and project 5d445535a4974186a835ab117109dca1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:23:06.131132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:23:06.134524 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='666511fc-dcaf-4302-b780-d5a3893f2512',volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:23:06.524886 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8cd3ebe9-9cb7-42ec-8919-93131590dcb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.007778 Aug 25 03:23:06.525582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 247/483] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:23:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:23:06.537159 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-56093258-1500-4680-9ad2-0915dde4fe83 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:06.537891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-56093258-1500-4680-9ad2-0915dde4fe83 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:06.541151 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=17 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:06.541859 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=49 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:06.596314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-56093258-1500-4680-9ad2-0915dde4fe83 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:06.603016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-56093258-1500-4680-9ad2-0915dde4fe83 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1094 microversion: 2.1 time: 0.070020 Aug 25 03:23:06.603588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 237/484] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:06 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:07.624516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:07.625129 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:07.631341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:07.631825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:07.632273 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:07.632956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:07.633469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:07.633885 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:07.704845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:07.713108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-178f8a5e-a510-4b5b-ac2a-9ae392ebac63 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1144 microversion: 2.1 time: 0.092938 Aug 25 03:23:07.713809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 248/485] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:07 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:08.737454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:08.738251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:08.752383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:08.753612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:08.754383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:08.755619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:08.756653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:08.757637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:08.845083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:08.853290 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aea1c9ea-407a-426c-8824-793b10c0cb8f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1200 microversion: 2.1 time: 0.123012 Aug 25 03:23:08.853842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 238/486] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:08 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:09.873931 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:09.874512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:09.880501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:09.880977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:09.881409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:09.882091 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:09.882579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:09.883004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:10.020265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:10.024741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2a0ce193-7d82-4ad1-b9d6-c2275888d2fb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1277 microversion: 2.1 time: 0.154940 Aug 25 03:23:10.025289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 249/487] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:09 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:11.044808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:11.045550 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:11.051885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:11.052431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:11.052858 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:11.053540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:11.053980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:11.054433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:11.183284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:11.192126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7664aed5-c6d7-489a-b799-9a12127912a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1277 microversion: 2.1 time: 0.151045 Aug 25 03:23:11.192713 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 239/488] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:11 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:12.023354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-fdf50b90-9539-4ec5-9db7-8996d54ec3c1 req-ac3c4069-c103-40cb-b967-bc3dd041599c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733fa4c6-b3ef-4350-a501-bbebf3ce0a19", "tag": "fd31addb-9fdc-40a4-8da4-6a52ce36791d"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:12.032686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fdf50b90-9539-4ec5-9db7-8996d54ec3c1 req-ac3c4069-c103-40cb-b967-bc3dd041599c service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:12.033157 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fdf50b90-9539-4ec5-9db7-8996d54ec3c1 req-ac3c4069-c103-40cb-b967-bc3dd041599c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:12.033583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-fdf50b90-9539-4ec5-9db7-8996d54ec3c1 req-ac3c4069-c103-40cb-b967-bc3dd041599c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:12.044983 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-fdf50b90-9539-4ec5-9db7-8996d54ec3c1 req-ac3c4069-c103-40cb-b967-bc3dd041599c service nova] Creating event network-changed:fd31addb-9fdc-40a4-8da4-6a52ce36791d for instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 on hv-cinder-85164 Aug 25 03:23:12.049999 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-fdf50b90-9539-4ec5-9db7-8996d54ec3c1 req-ac3c4069-c103-40cb-b967-bc3dd041599c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030332 Aug 25 03:23:12.050700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 250/489] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:12.213477 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:12.214164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:12.220805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:12.221277 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:12.221765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:12.222471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:12.222918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:12.223334 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:12.354444 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:12.361986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6ce05669-e400-409e-a43a-58eb00529f51 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1277 microversion: 2.1 time: 0.152890 Aug 25 03:23:12.362578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 240/490] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:12 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:13.383286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:13.383980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:13.389855 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:13.392800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:13.392800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:13.392800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:13.392800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:13.393172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:13.521105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:13.528817 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ea5bad2-e958-47ea-98a2-6bac6a9f7e41 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1277 microversion: 2.1 time: 0.149759 Aug 25 03:23:13.529379 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 251/491] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:13 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:14.550005 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:14.551259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:14.558393 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:14.559204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:14.559825 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:14.560702 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:14.561327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:14.561755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:14.698937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:14.706770 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b5a87b9b-3233-4ff3-ba12-845560287d67 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1277 microversion: 2.1 time: 0.160488 Aug 25 03:23:14.707341 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 241/492] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:14 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:15.727263 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:15.727904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:15.734464 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:15.734950 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:15.735381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:15.736116 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:15.736522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:15.736943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:15.872448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:15.880013 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-820dae0c-bb32-49f0-b88f-026cbbe175d0 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.156656 Aug 25 03:23:15.880580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 252/493] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:15 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:16.901905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:16.902475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:16.905371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:16.910106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:16.910683 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:16.915356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:16.915356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:16.915356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:16.915356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:17.043406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:17.051129 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1c36e42d-4eae-4512-aa43-e6cfa21bcd23 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.153776 Aug 25 03:23:17.051700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 242/494] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:16 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:18.071028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:18.071813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:18.074738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:18.075477 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:18.091597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:18.091597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:18.091597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:18.091597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:18.091990 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:18.091990 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:18.217637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:18.225289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b50e69dc-dc01-4c25-a478-0e704a696593 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.158480 Aug 25 03:23:18.225865 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 253/495] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:18 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:19.246865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:19.247473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:19.253863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:19.254367 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:19.254806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:19.255486 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:19.256012 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:19.256433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:19.388765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:19.396496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b4edd5b1-a13d-497d-8191-ea7a0aec1483 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.154132 Aug 25 03:23:19.397065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 243/496] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:19 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:20.416865 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:20.417598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:20.424765 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:20.428236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:20.428236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:20.428236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:20.428236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:20.428681 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:20.563454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:20.571578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e652fe6b-71f0-468d-93fa-d08a03c8a02a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.158562 Aug 25 03:23:20.572163 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 254/497] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:20 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:21.593218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:21.594059 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:21.600797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:21.601278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:21.601718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:21.602449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:21.602904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:21.603331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:21.737351 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:21.745007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a76c0f47-7eb0-401e-9db0-cadec3beafd9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.156291 Aug 25 03:23:21.745539 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 244/498] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:21 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:22.765637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:22.766246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:22.772557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:22.773031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:22.773461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:22.774143 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:22.774625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:22.775044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:22.912054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:22.915789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-66313ebc-30e0-49da-9f51-70a8e05537dc tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.154641 Aug 25 03:23:22.916355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 255/499] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:22 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:23.937195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:23.937861 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:23.944323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:23.945051 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:23.945482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:23.946194 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:23.946674 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:23.947095 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:24.087171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:24.095080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-83df092d-97c0-40a2-96d1-d6bc24cce172 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.161981 Aug 25 03:23:24.095648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 245/500] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:23 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:25.116149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:25.116808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:25.123709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:25.124189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:25.124615 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:25.125310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:25.125752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:25.126163 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:25.258425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:25.267139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-be8f204f-a25a-41a4-8f1a-657c3740bc49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.154871 Aug 25 03:23:25.267714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 256/501] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:25 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:26.288854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:26.289430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:26.296039 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:26.296515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:26.296941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:26.297647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:26.298091 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:26.298542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:26.434434 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:26.442018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-40981d05-41eb-482e-83b6-07b8665199ca tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.157255 Aug 25 03:23:26.442619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 246/502] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:26 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:27.463365 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:27.464106 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:27.471497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:27.471973 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:27.472396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:27.473196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:27.473641 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:27.474050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:27.608988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:27.617040 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-45abfd97-1904-4d21-89b7-cd35bd5a1938 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.157780 Aug 25 03:23:27.617613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 257/503] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:27 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:27.928892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-c307bd94-1a17-41d1-a729-afcbe6ee4c68 req-b146e442-619b-4802-b9aa-e4ba7775a5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733fa4c6-b3ef-4350-a501-bbebf3ce0a19", "name": "network-vif-plugged", "status": "completed", "tag": "fd31addb-9fdc-40a4-8da4-6a52ce36791d"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:27.939876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-c307bd94-1a17-41d1-a729-afcbe6ee4c68 req-b146e442-619b-4802-b9aa-e4ba7775a5d3 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:27.940346 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-c307bd94-1a17-41d1-a729-afcbe6ee4c68 req-b146e442-619b-4802-b9aa-e4ba7775a5d3 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:27.940793 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-c307bd94-1a17-41d1-a729-afcbe6ee4c68 req-b146e442-619b-4802-b9aa-e4ba7775a5d3 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:27.952668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-c307bd94-1a17-41d1-a729-afcbe6ee4c68 req-b146e442-619b-4802-b9aa-e4ba7775a5d3 service nova] Creating event network-vif-plugged:fd31addb-9fdc-40a4-8da4-6a52ce36791d for instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 on hv-cinder-85164 Aug 25 03:23:27.957671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-c307bd94-1a17-41d1-a729-afcbe6ee4c68 req-b146e442-619b-4802-b9aa-e4ba7775a5d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032462 Aug 25 03:23:27.958272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 247/504] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:28.637149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:28.637730 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:28.643726 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:28.644201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:28.644627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:28.645309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:28.645759 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:28.646177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:28.781388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:28.790301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-425ee901-11b7-417c-a1bd-3cfb3ae73057 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.156846 Aug 25 03:23:28.790894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 258/505] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:28 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:29.812318 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:29.812924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:29.819056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:29.819807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:29.820235 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:29.820913 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:29.821359 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:29.821782 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:29.957780 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:29.965627 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-afa212c3-fdb7-4c32-986d-09f4fd9f2158 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1265 microversion: 2.1 time: 0.158561 Aug 25 03:23:29.966260 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 248/506] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:29 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:30.987456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:30.988032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:30.994110 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:30.994617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:30.995048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:30.995729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:30.996175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:30.996593 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:31.140970 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:31.148804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-99e42b5e-9f7a-41dd-bbee-04c3bfbed982 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1451 microversion: 2.1 time: 0.165600 Aug 25 03:23:31.149376 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 259/507] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:30 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:31.168974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:31.169574 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:31.176408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:31.176879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:31.177301 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:31.178007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:31.178481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:31.178898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:31.310102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:31.318877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bb7c9068-aa5c-41e0-8d0a-86f553d708b1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1451 microversion: 2.1 time: 0.153857 Aug 25 03:23:31.319704 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 249/508] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:31 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:33.265721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-e3a39831-fc8a-4def-935d-2743120e2a3f req-b750aa66-b9e6-4beb-973c-e90968e98ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733fa4c6-b3ef-4350-a501-bbebf3ce0a19", "tag": "fd31addb-9fdc-40a4-8da4-6a52ce36791d"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:33.275109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e3a39831-fc8a-4def-935d-2743120e2a3f req-b750aa66-b9e6-4beb-973c-e90968e98ff2 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:33.275671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e3a39831-fc8a-4def-935d-2743120e2a3f req-b750aa66-b9e6-4beb-973c-e90968e98ff2 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:33.276095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e3a39831-fc8a-4def-935d-2743120e2a3f req-b750aa66-b9e6-4beb-973c-e90968e98ff2 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:33.286805 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-e3a39831-fc8a-4def-935d-2743120e2a3f req-b750aa66-b9e6-4beb-973c-e90968e98ff2 service nova] Creating event network-changed:fd31addb-9fdc-40a4-8da4-6a52ce36791d for instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 on hv-cinder-85164 Aug 25 03:23:33.291908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-e3a39831-fc8a-4def-935d-2743120e2a3f req-b750aa66-b9e6-4beb-973c-e90968e98ff2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030555 Aug 25 03:23:33.292433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 260/509] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:34.792095 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:34.792662 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:34.799144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:34.799650 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:34.800080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:34.800961 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:34.801421 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:34.801862 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:34.825940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2d447df5-0167-4afd-920e-327112402226 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/ips" status: 200 len: 146 microversion: 2.1 time: 0.037753 Aug 25 03:23:34.827116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 250/510] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:23:34 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:39.332321 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a898187-290a-46f9-b527-0c6fa68b998e"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:39.334846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:39.337081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:39.342576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:39.344834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:39.344834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:39.344834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:39.344834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:39.345188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:39.348581 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=73 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:40.101811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dc594f6f-bdb8-41a7-a2cc-d53d2efa567d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774221 Aug 25 03:23:40.102507 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 261/511] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:23:39 2022] POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:48.684461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1b700e8d-9eca-49ad-8f2e-e738d0aa0aff tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:48.687593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=30 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:48.688301 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=72 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:48.693030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b700e8d-9eca-49ad-8f2e-e738d0aa0aff tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:48.693516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b700e8d-9eca-49ad-8f2e-e738d0aa0aff tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:48.694203 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b700e8d-9eca-49ad-8f2e-e738d0aa0aff tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:48.755589 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1b700e8d-9eca-49ad-8f2e-e738d0aa0aff tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Going to try to stop instance {{(pid=121278) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 03:23:48.974430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1b700e8d-9eca-49ad-8f2e-e738d0aa0aff tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action" status: 202 len: 0 microversion: 2.1 time: 0.293642 Aug 25 03:23:48.975097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 251/512] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:23:48 2022] POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:23:48.984580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:48.985287 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:48.991688 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:48.992171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:48.992606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:48.993301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:48.993750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:48.994179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:49.240517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:49.249373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0c5c9b4a-fdb8-4807-bfef-1bc7aabf7f27 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.269141 Aug 25 03:23:49.250019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 262/513] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:48 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:50.271260 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:50.272038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:50.278259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:50.278761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:50.279192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:50.279878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:50.280323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:50.280744 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:50.456652 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:50.464801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-551cd488-5be9-4ca5-b9cd-ee4350d3fabb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.197947 Aug 25 03:23:50.465360 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 252/514] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:50 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:51.484991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:51.485606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:51.492575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:51.493051 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:51.493481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:51.494166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:51.494639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:51.495062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:51.635474 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:51.645052 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e9b3efe-05ef-4f7f-991f-3679bc7b7bf9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.163899 Aug 25 03:23:51.645635 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 263/515] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:51 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:52.666346 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:52.666963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:52.673431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:52.673916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:52.674385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:52.675078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:52.675527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:52.675948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:52.805503 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:52.814451 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3d25e2b4-e6ef-4de7-81f5-e8c4a644cea0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.152092 Aug 25 03:23:52.815119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 253/516] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:52 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:53.835198 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:53.835810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:53.842356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:53.843427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:53.843857 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:53.844571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:53.845019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:53.845438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:53.978785 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:53.987328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a3036423-ad05-4f20-85b1-3b474d3f9c97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.156174 Aug 25 03:23:53.987954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 264/517] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:53 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:23:55.009229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:55.009974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:55.016908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:55.017551 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:55.018055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:55.018899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:55.019426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:55.019943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:55.155868 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:55.164104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-977127e2-b809-40a6-8d00-71479b225b79 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.158939 Aug 25 03:23:55.164676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 254/518] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:55 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:56.186459 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:56.187364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:56.195077 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:56.195844 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:56.196278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:56.196993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:56.197608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:56.198028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:56.379650 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:56.388412 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3b448e3c-39e0-4bc2-af73-2bf4ed2dcb7f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.206979 Aug 25 03:23:56.391357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 265/519] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:56 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:23:57.412956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:57.413798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:57.420571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:57.421177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:57.421721 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:57.422554 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:57.423110 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:57.423643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:57.604818 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:57.624283 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d51bae0c-b8ea-429c-8197-ec56a8b49bac tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.215205 Aug 25 03:23:57.624882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 255/520] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:57 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:58.645362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:58.645981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:58.652715 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:58.653452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:58.653883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:58.655131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:58.655920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:58.656335 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:58.817484 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:58.827833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d5797cf3-068b-452d-8d51-46a0dcc88edd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.186532 Aug 25 03:23:58.828445 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 266/521] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:58 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:59.849763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:59.850777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:59.858441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:59.858948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:59.859391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:59.860100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:59.860556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:59.861730 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:00.026820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:00.051065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-80fe4be8-7eea-4b07-b217-002dc57b1df4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.206023 Aug 25 03:24:00.051663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 256/522] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:59 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:01.072974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:01.073558 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:01.080819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:01.081306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:01.081737 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:01.082625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:01.083010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:01.083434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:01.234226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:01.245087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-772b94d8-6ffa-4726-9c8e-6ee600b37fd8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.175579 Aug 25 03:24:01.246151 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 267/523] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:01 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:02.271697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:02.272747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:02.279801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:02.280438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:02.281015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:02.281945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:02.282599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:02.283289 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:02.433027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:02.444233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-24c39aba-377d-4d27-a2bc-9297c89dba40 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.176746 Aug 25 03:24:02.449418 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 257/524] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:02 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:03.731255 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:03.733347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:03.738548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:03.739034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:03.739470 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:03.740357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:03.740879 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:03.741307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:03.894433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:03.907332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f5b400f6-b704-4573-ac23-954ec04717bd tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1724 microversion: 2.1 time: 0.444550 Aug 25 03:24:03.908856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 268/525] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:03 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:04.931198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:04.932490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:04.938640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:04.939127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:04.939675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:04.940257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:04.940881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:04.941496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:05.109340 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:05.118594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5023f563-1ef0-404d-b0b4-deed8d1f5f0f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1701 microversion: 2.1 time: 0.191874 Aug 25 03:24:05.119848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 258/526] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:04 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1701 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:05.143054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-382ec921-e416-44c0-bd56-4cfd912b84fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:05.150907 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-382ec921-e416-44c0-bd56-4cfd912b84fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:05.151393 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-382ec921-e416-44c0-bd56-4cfd912b84fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:05.151878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-382ec921-e416-44c0-bd56-4cfd912b84fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:05.222751 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-382ec921-e416-44c0-bd56-4cfd912b84fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Going to try to start instance {{(pid=121277) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 03:24:05.403214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-382ec921-e416-44c0-bd56-4cfd912b84fc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action" status: 202 len: 0 microversion: 2.1 time: 0.265638 Aug 25 03:24:05.405024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 269/527] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:24:05 2022] POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:24:05.418957 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:05.426237 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:05.444597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:05.445084 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:05.445514 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:05.448919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:05.449697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:05.450506 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:05.676257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:05.690847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b1dbd61f-8a15-4d18-88bb-d30b06a5070c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1710 microversion: 2.1 time: 0.279586 Aug 25 03:24:05.694661 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 259/528] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:05 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1710 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:06.718657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:06.720219 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:06.734569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:06.734980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:06.736880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:06.737589 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:06.738037 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:06.738517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:06.915200 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:06.928533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4a58e9aa-e3cb-4180-9306-0804590fba66 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1710 microversion: 2.1 time: 0.216173 Aug 25 03:24:06.929617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 270/529] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:06 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1710 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:07.953600 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:07.954423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:07.961567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:07.962049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:07.962606 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:07.963370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:07.963868 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:07.964382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:08.108831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:08.116943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-11fb2acc-23ae-4b58-b8b6-9c451e805e90 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1710 microversion: 2.1 time: 0.168404 Aug 25 03:24:08.117510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 260/530] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:07 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1710 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:09.138171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:09.139442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:09.146222 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:09.147976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:09.149160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:09.149993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:09.150558 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:09.151063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:09.301203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:09.312806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a0500812-07fe-41be-932f-857188f18282 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1714 microversion: 2.1 time: 0.178365 Aug 25 03:24:09.313473 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 271/531] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:09 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1714 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:15.480046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3c1b55a8-88d6-4ab8-b66d-dd8eebad93a7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Action: 'create', calling method: .version_select at 0x7fa33a779280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-874095792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+DKAS6JrnFiC8K9tIl2sCMC0QKFm9qQTMThqg9e5nrE9mivIkj6d/WTZcl3TOqHhQE9dYFRc/sTqffRJft0snoNC4F5v48XeIkIpaUWwmZDijfPLftWsOzH+7LNXPF8A=="}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:15.501794 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-3c1b55a8-88d6-4ab8-b66d-dd8eebad93a7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Getting quotas for project 3e91375fe4114bf98447ccfcb6f8475f. Resources: {'key_pairs'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:24:15.505641 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-3c1b55a8-88d6-4ab8-b66d-dd8eebad93a7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Getting quotas for user dd2985023e274f19a868da37aa791859 and project 3e91375fe4114bf98447ccfcb6f8475f. Resources: {'key_pairs'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:24:15.612339 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3c1b55a8-88d6-4ab8-b66d-dd8eebad93a7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136018 Aug 25 03:24:15.612854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 261/532] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:24:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:15.721848 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1993567858", "imageRef": "a3102122-a891-4750-9d81-764b83471553", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-874095792", "networks": [{"uuid": "700b7c79-3766-4320-90fd-716df2437c15"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:15.731097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=22 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:15.777131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] validate_networks() for [('700b7c79-3766-4320-90fd-716df2437c15', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:24:16.241756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:24:16.242340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:24:16.242826 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:24:16.243261 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:24:16.243673 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:24:16.253006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:16.253485 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:16.254079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:16.254824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:16.255278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:16.255698 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:16.261296 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:16.273337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Getting quotas for project 3e91375fe4114bf98447ccfcb6f8475f. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:24:16.277290 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Getting quotas for user dd2985023e274f19a868da37aa791859 and project 3e91375fe4114bf98447ccfcb6f8475f. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:24:16.289153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:24:16.291497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3102122-a891-4750-9d81-764b83471553',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:24:16.412250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-baa76ade-4f2b-4cea-a316-fd32100fe162 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694261 Aug 25 03:24:16.412890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 272/533] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:24:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:24:16.424180 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-768c5ad8-b651-466d-bdf7-b102b8527c9b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:16.424940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-768c5ad8-b651-466d-bdf7-b102b8527c9b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:16.480194 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-768c5ad8-b651-466d-bdf7-b102b8527c9b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:16.488406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-768c5ad8-b651-466d-bdf7-b102b8527c9b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1258 microversion: 2.1 time: 0.068692 Aug 25 03:24:16.489046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 262/534] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:16 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:17.510414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c26ef0e3-698b-49e4-bae0-fddc5fed2682 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:17.511046 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c26ef0e3-698b-49e4-bae0-fddc5fed2682 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:17.565437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c26ef0e3-698b-49e4-bae0-fddc5fed2682 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:17.572910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c26ef0e3-698b-49e4-bae0-fddc5fed2682 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1258 microversion: 2.1 time: 0.067305 Aug 25 03:24:17.573684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 273/535] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:17 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:18.594020 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:18.594648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:18.597077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:18.602087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:18.602535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:18.602985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:18.603639 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:18.604081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:18.604496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:18.676111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:18.683767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5e8b10e7-8413-4324-8d08-02483eb97c48 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1310 microversion: 2.1 time: 0.094253 Aug 25 03:24:18.685230 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 263/536] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:18 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:19.705953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:19.706592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:19.721209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:19.721209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:19.721209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:19.721209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:19.721786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:19.721786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:19.897571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:19.907748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-93703b78-3f8b-4462-9070-2895e940acc8 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.206505 Aug 25 03:24:19.908642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 274/537] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:19 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:20.931485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:20.932153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:20.934302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:20.939997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:20.940499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:20.940930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:20.941618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:20.942066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:20.942509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:21.076823 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:21.089319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-16bf60d5-28e9-4dc7-8eba-76720d7ae7fb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.161996 Aug 25 03:24:21.089899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 264/538] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:20 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:22.109992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:22.110764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:22.117208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:22.117881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:22.118322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:22.119012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:22.119455 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:22.119871 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:22.266694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:22.274666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-28327420-4e49-474b-9f85-d43537603590 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.168408 Aug 25 03:24:22.275244 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 275/539] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:22 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:23.296306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:23.296915 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:23.303821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:23.304300 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:23.304760 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:23.305461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:23.305908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:23.306367 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:23.438912 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:23.448307 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-02be4a5b-7689-4cb4-a584-0184b58350dd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.156367 Aug 25 03:24:23.449437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 265/540] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:23 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:24.469412 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:24.470094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:24.476607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:24.477088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:24.477520 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:24.478212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:24.479305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:24.479733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:24.616141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:24.626913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-759f83f0-2a20-445b-b40b-148cf2264a97 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.161279 Aug 25 03:24:24.627516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 276/541] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:24 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:25.068319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:25.069228 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:25.075597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:25.076105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:25.076544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:25.077745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:25.078196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:25.078640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:25.107462 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-269c7900-b549-475f-a7bf-e164f31756fa tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/ips" status: 200 len: 150 microversion: 2.1 time: 0.043243 Aug 25 03:24:25.108288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 266/542] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:24:25 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:25.651632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:25.652239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:25.658982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:25.659366 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:25.659803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:25.660497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:25.660950 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:25.661374 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:25.843035 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:25.851347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5d8b3ea3-113a-4487-bde4-86ae67ddd1de tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.203647 Aug 25 03:24:25.857144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 277/543] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:25 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:26.888734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:26.889413 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:26.892762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:26.897631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:26.898358 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:26.898784 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:26.899493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:26.900042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:26.900464 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:27.034635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:27.042940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4c787610-328c-41ba-b40a-887c5d3cba7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.158171 Aug 25 03:24:27.043515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 267/544] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:26 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:27.922810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47bd704b-a8c5-41b2-b108-29e218fab13d"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:27.925241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:27.928266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:27.929669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=8 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:27.933282 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:27.934002 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:27.934430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:27.941686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:27.941686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:27.941686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:28.064816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:28.065416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:28.072229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:28.073131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:28.073717 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:28.074597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:28.075044 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:28.075461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:28.216573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:28.224807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7f2aa082-c219-4800-932c-80653433df31 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.164733 Aug 25 03:24:28.225391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 268/545] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:28 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:29.245139 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:29.245829 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:29.252213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:29.252693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:29.253126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:29.253821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:29.254274 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:29.254722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:29.388040 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:29.396231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5cbaa2c8-1b12-4f10-9a7f-678273e47336 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.155027 Aug 25 03:24:29.396809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 269/546] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:29 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:30.417422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:30.418097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:30.425025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:30.425589 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:30.426029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:30.426751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:30.427201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:30.427626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:30.560251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:30.571149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bc67f702-6b42-429c-987f-a90008aa5e9a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.157526 Aug 25 03:24:30.571736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 270/547] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:30 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:31.592109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:31.593246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:31.599610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:31.600079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:31.600499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:31.601193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:31.601635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:31.602045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:31.727207 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:31.735452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-be9b80a8-7dd7-47b7-956d-9bede84b103b tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.147235 Aug 25 03:24:31.736018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 271/548] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:31 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:32.756057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:32.756673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:32.763042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:32.763512 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:32.763942 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:32.764624 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:32.765069 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:32.765482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:32.891663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:32.900139 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-43e6b1f2-57f0-4d24-98f0-851c6a108517 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.147955 Aug 25 03:24:32.900710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 272/549] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:32 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:33.923866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:33.924575 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:33.931030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:33.931501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:33.931926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:33.932671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:33.933112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:33.933525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:34.019754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cd267f15-c426-4b43-a308-36a8a847d544 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.101321 Aug 25 03:24:34.020845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 278/550] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:24:27 2022] POST /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments => generated 194 bytes in 6103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:34.103981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:34.112152 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c46fce7a-ceaa-48be-9259-edba1a99bd90 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.192360 Aug 25 03:24:34.112719 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 273/551] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:33 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:34.424912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-702db598-8467-4b23-8260-8f1b85409479 req-f26eb201-14c4-490a-b9a7-70f41060fd66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53665120-a0da-4bc4-ab99-311a2ba24558", "tag": "74af88e4-8cbe-453a-8e1b-763221404911"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:34.434661 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-702db598-8467-4b23-8260-8f1b85409479 req-f26eb201-14c4-490a-b9a7-70f41060fd66 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:34.435132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-702db598-8467-4b23-8260-8f1b85409479 req-f26eb201-14c4-490a-b9a7-70f41060fd66 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:34.435554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-702db598-8467-4b23-8260-8f1b85409479 req-f26eb201-14c4-490a-b9a7-70f41060fd66 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:34.446486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-702db598-8467-4b23-8260-8f1b85409479 req-f26eb201-14c4-490a-b9a7-70f41060fd66 service nova] Creating event network-changed:74af88e4-8cbe-453a-8e1b-763221404911 for instance 53665120-a0da-4bc4-ab99-311a2ba24558 on hv-cinder-85164 Aug 25 03:24:34.451196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-702db598-8467-4b23-8260-8f1b85409479 req-f26eb201-14c4-490a-b9a7-70f41060fd66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090041 Aug 25 03:24:34.451766 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 279/552] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:35.133272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:35.133975 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:35.141027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:35.141507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:35.141940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:35.142664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:35.143118 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:35.143539 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:35.273726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:35.281276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a5216f6a-8921-416b-a7aa-cd54efa09280 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.151845 Aug 25 03:24:35.281850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 274/553] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:35 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:36.302897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:36.303580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:36.310088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:36.310592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:36.311024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:36.311704 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:36.312151 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:36.312602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:36.442581 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:36.450229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b99cf082-bd28-4215-9ad9-c13421977c34 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.152937 Aug 25 03:24:36.450845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 280/554] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:36 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:37.131599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b93a3d89-4929-4cad-9382-9860bf26047a"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:37.134005 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:37.139925 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:37.140391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:37.140815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:37.141487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:37.141927 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:37.142371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:37.471961 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:37.472573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:37.478984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:37.479461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:37.479897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:37.480580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:37.481028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:37.481447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:37.612654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:37.620216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a42fb1b9-3fed-45bf-bb6e-5fd74f6fd534 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.152573 Aug 25 03:24:37.620774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 281/555] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:37 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:38.641722 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:38.642519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:38.649787 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:38.651578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:38.651578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:38.651578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:38.652060 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:38.652367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:38.825747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:38.833308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8460b1cf-1a12-4340-9b2c-54589706e08a tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.195479 Aug 25 03:24:38.833884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 282/556] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:38 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:38.881975 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-84584e79-d9d7-42af-a03f-a01e1f951b72 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.858037 Aug 25 03:24:38.882847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 275/557] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:24:37 2022] POST /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments => generated 194 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:39.854596 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:39.855202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:39.861519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:39.861994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:39.862461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:39.863145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:39.863592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:39.864046 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:39.997366 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:40.005977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9fd23647-ad55-4625-8d5a-9499b0d806ec tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.155298 Aug 25 03:24:40.006667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 283/558] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:39 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:41.027262 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:41.027956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:41.034650 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:41.035127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:41.035563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:41.036260 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:41.036711 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:41.037137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:41.169879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:41.177613 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-973194f5-95dc-48c8-aad8-7e2c763f1e06 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.155156 Aug 25 03:24:41.178177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 276/559] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:41 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:42.199718 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:42.199718 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:42.206449 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:42.206939 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:42.207381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:42.208073 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:42.208526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:42.208946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:42.342802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:42.351625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4891e1de-ff2b-4ce6-ae23-9d325c1bcda4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.156607 Aug 25 03:24:42.352213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 284/560] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:42 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:42.409030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-9af1e7fe-5612-446f-a911-75f8bf79831f req-d8a4a5d9-d66e-431a-8553-f26fe01d0660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53665120-a0da-4bc4-ab99-311a2ba24558", "name": "network-vif-plugged", "status": "completed", "tag": "74af88e4-8cbe-453a-8e1b-763221404911"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:42.418922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9af1e7fe-5612-446f-a911-75f8bf79831f req-d8a4a5d9-d66e-431a-8553-f26fe01d0660 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:42.419390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9af1e7fe-5612-446f-a911-75f8bf79831f req-d8a4a5d9-d66e-431a-8553-f26fe01d0660 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:42.419815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9af1e7fe-5612-446f-a911-75f8bf79831f req-d8a4a5d9-d66e-431a-8553-f26fe01d0660 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:42.430401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-9af1e7fe-5612-446f-a911-75f8bf79831f req-d8a4a5d9-d66e-431a-8553-f26fe01d0660 service nova] Creating event network-vif-plugged:74af88e4-8cbe-453a-8e1b-763221404911 for instance 53665120-a0da-4bc4-ab99-311a2ba24558 on hv-cinder-85164 Aug 25 03:24:42.435436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-9af1e7fe-5612-446f-a911-75f8bf79831f req-d8a4a5d9-d66e-431a-8553-f26fe01d0660 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Aug 25 03:24:42.436080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 277/561] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:43.372822 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:43.373413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:43.379834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:43.380314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:43.380748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:43.381436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:43.381886 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:43.382331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:43.508029 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:43.515722 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c6fb628e-13a1-482c-b382-92a20d1428bc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.146778 Aug 25 03:24:43.516300 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 285/562] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:43 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:44.537912 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:44.538632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:44.544883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:44.545379 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:44.545803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:44.547064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:44.547523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:44.547940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:44.679368 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:44.687833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-450c7cdd-cd44-4d18-8357-05dae7c5bff9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1358 microversion: 2.1 time: 0.154714 Aug 25 03:24:44.688435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 278/563] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:44 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:45.709158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:45.709767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:45.716244 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:45.716721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:45.717153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:45.717864 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:45.718359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:45.718756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:45.848349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:45.856292 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a4d4d749-2050-49f3-b042-feab0d18b6e4 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1548 microversion: 2.1 time: 0.150892 Aug 25 03:24:45.856873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 286/564] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:45 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:45.884478 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:45.885076 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:45.892147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:45.898195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:45.898195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:45.898195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:45.898195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:45.898673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:45.898673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:46.022636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:46.030066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c307defc-5160-4429-80f8-d92b3141dfe7 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1548 microversion: 2.1 time: 0.149461 Aug 25 03:24:46.030675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 279/565] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:45 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:46.050309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:46.054971 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:46.055741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Searching by: {'deleted': False, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f'} {{(pid=121277) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 03:24:46.057631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:46.063605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:46.064337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:46.064487 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:46.065196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:46.065640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:46.066056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:46.158302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.multi_cell_list [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 03:24:46.256952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-279e065d-bb0d-4c5b-a495-dcb781e4bdac tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211021 Aug 25 03:24:46.257535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 287/566] 10.222.0.58 () {58 vars in 1125 bytes} [Thu Aug 25 03:24:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:46.268960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:46.269566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:46.276165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:46.276679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:46.277050 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:46.277726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:46.278173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:46.278621 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:46.413321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:46.421567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-15d02704-6da9-4fd6-a2b5-f0eb01001dcb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1548 microversion: 2.1 time: 0.155961 Aug 25 03:24:46.422147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 280/567] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:46 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:47.105822 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8ba998d8-6316-4734-80e3-0739a6a8fd6b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: .version_select at 0x7fa33a83cd30>, body: {"keypair": {"name": "tempest-keypair-1227137421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUtLbjFFWkI5QBc3A/ul47v4je0VC/60CkXuU/5M8HkhuIxRURov078N6omNLmql2N9rGjHguVXjgTL1FZPQj4ZOX2s9bx7smaBxURc6/pyXAykwf/KwsF1KX8bpZLNAw=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:47.124578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-8ba998d8-6316-4734-80e3-0739a6a8fd6b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:24:47.128988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-8ba998d8-6316-4734-80e3-0739a6a8fd6b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:24:47.205501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8ba998d8-6316-4734-80e3-0739a6a8fd6b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103381 Aug 25 03:24:47.206117 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 288/568] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:24:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:49.259667 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1582866062", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "256737dd-9a94-4238-9f74-9979facae111"}], "security_groups": [{"name": "tempest-securitygroup--699889734"}], "key_name": "tempest-keypair-1227137421", "user_data": "}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:49.364222 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:49.366569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:49.368893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] validate_networks() for [('256737dd-9a94-4238-9f74-9979facae111', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:24:49.373878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:49.374408 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:49.374845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:49.375538 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:49.375987 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:49.376408 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:49.378895 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:49.796183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:24:49.796599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:24:49.797065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:24:49.797498 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:24:49.797907 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:24:49.806695 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:49.807167 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:49.807596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:49.808317 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:49.808761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:49.809177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:49.828272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:24:49.832269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:24:49.844010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:24:49.846317 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:24:49.971906 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d62f4921-8706-4046-996a-ae005c014fec tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.716727 Aug 25 03:24:49.972483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 281/569] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:24:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:24:49.983069 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e054c7ef-3494-414a-9ae9-d2c5c27e525d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:49.983680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e054c7ef-3494-414a-9ae9-d2c5c27e525d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:49.990903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cd06734c-e571-45b9-b401-3595cc220bdd tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634803 Aug 25 03:24:49.993639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 289/570] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:24:49 2022] POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:24:50.040534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e054c7ef-3494-414a-9ae9-d2c5c27e525d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:50.048596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e054c7ef-3494-414a-9ae9-d2c5c27e525d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1242 microversion: 2.1 time: 0.069154 Aug 25 03:24:50.049671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 282/571] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:49 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:51.070607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:51.071306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:51.077974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:51.078524 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:51.078955 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:51.079650 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:51.080099 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:51.080513 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:51.149098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:51.157309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0b652fb2-c2a1-4020-8a5e-34520964be2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1238 microversion: 2.1 time: 0.092167 Aug 25 03:24:51.157881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 290/572] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:51 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:52.179655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:52.180352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:52.183187 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:52.190098 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:52.191063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:52.191798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:52.193609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:52.193609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:52.193902 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:52.263011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:52.270966 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e45be15f-c475-4e6e-8a5d-9ec02e374512 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1300 microversion: 2.1 time: 0.096622 Aug 25 03:24:52.271553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 283/573] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:52 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:53.292866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:53.293477 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:53.299828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:53.300297 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:53.300720 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:53.301389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:53.301828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:53.302270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:53.536019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:53.543766 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8c7907fa-595f-430f-a325-65b745fbe551 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.254672 Aug 25 03:24:53.544337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 291/574] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:53 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:53.652316 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-f4fbf3bb-ee19-421d-8708-02e1b2025614 req-99bb2b4c-a74e-4beb-bf74-78585896cf48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d66607-d18c-4819-a699-018f461be7ec", "tag": "981f3602-e4ac-40b3-a185-b66b8fbe7b1b"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:53.663190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f4fbf3bb-ee19-421d-8708-02e1b2025614 req-99bb2b4c-a74e-4beb-bf74-78585896cf48 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:53.663857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f4fbf3bb-ee19-421d-8708-02e1b2025614 req-99bb2b4c-a74e-4beb-bf74-78585896cf48 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:53.664406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f4fbf3bb-ee19-421d-8708-02e1b2025614 req-99bb2b4c-a74e-4beb-bf74-78585896cf48 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:53.681768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-f4fbf3bb-ee19-421d-8708-02e1b2025614 req-99bb2b4c-a74e-4beb-bf74-78585896cf48 service nova] Creating event network-changed:981f3602-e4ac-40b3-a185-b66b8fbe7b1b for instance 83d66607-d18c-4819-a699-018f461be7ec on hv-cinder-85164 Aug 25 03:24:53.688552 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-f4fbf3bb-ee19-421d-8708-02e1b2025614 req-99bb2b4c-a74e-4beb-bf74-78585896cf48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038924 Aug 25 03:24:53.689473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 284/575] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:24:54.565104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:54.565649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:54.572343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:54.572818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:54.573240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:54.573920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:54.574427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:54.574791 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:54.706425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:54.714303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e597554b-cedc-4c5a-a5d4-bff38a5a85de tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.153124 Aug 25 03:24:54.714899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 292/576] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:54 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:54.878550 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:24:54.880985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:54.887564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:54.888043 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:54.888479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:54.889162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:54.889612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:54.890708 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:54.913282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lazy-loading 'flavor' on Instance uuid e2e2d76b-15ac-4d15-bd62-9835364dabc3 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:24:55.161003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ad602e8d-9ae7-43e0-bfd2-828165b627e9 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/action" status: 200 len: 32 microversion: 2.1 time: 0.287211 Aug 25 03:24:55.161605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 285/577] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:24:54 2022] POST /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:24:55.171296 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:55.172445 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:55.178342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:55.178821 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:55.179254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:55.179935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:55.180387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:55.180931 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:55.309473 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:55.318572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1d86410a-97fe-460f-b564-1703d8c6412a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.151059 Aug 25 03:24:55.319122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 293/578] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:55 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:24:55.735073 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:55.736255 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:55.742452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:55.742952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:55.743397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:55.744085 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:55.744535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:55.744955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:55.886233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:55.894918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-dd819bc8-706c-4b36-a17f-95992115cd53 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.164196 Aug 25 03:24:55.895537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 286/579] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:55 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:56.339975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:56.340601 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:56.343232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:56.348875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:56.349484 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:56.350047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:56.351663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:56.351663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:56.351957 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:56.488580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:56.496709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-da2d3057-b3c9-4f16-a4c0-46e663543278 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.160791 Aug 25 03:24:56.497305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 294/580] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:56 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:56.916343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:56.916983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:56.924041 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:56.924523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:56.924956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:56.925645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:56.926101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:56.926559 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:57.056763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:57.065026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9e23238d-f3a3-4dc7-867d-4cf3af5fe6f9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.152560 Aug 25 03:24:57.065663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 287/581] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:56 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:57.521721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:57.522371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:57.524666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:24:57.530229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:57.536811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:57.536811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:57.536811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:57.536811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:57.537217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:57.736991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:57.743478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-72b76ff3-c46f-4287-8d88-c6cf3052299a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.226457 Aug 25 03:24:57.744120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 295/582] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:57 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:58.086425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:58.087045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:58.093109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:58.093587 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:58.094020 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:58.094752 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:58.095210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:58.095633 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:58.529625 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:58.541537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8bc840be-145b-4d5f-95f7-ecd78728067f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.459028 Aug 25 03:24:58.542122 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 288/583] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:58 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:58.765534 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:58.766164 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:58.773381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:58.773859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:58.774397 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:58.775083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:58.775527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:58.775938 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:58.903610 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:58.912505 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bf9956b1-be8d-4f5e-a859-c6899dab570c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.150947 Aug 25 03:24:58.913082 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 296/584] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:58 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:59.563497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:59.564121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:59.572250 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:59.572626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:59.573055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:59.573747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:59.574195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:59.574693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:59.706661 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:24:59.714088 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7059da25-151c-4572-b143-412fc631e4c6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.154716 Aug 25 03:24:59.714689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 289/585] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:59 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:24:59.933047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:24:59.933652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:24:59.940203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:59.940674 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:59.941097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:24:59.942024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:24:59.942502 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:24:59.942919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:00.104763 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:00.113652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1e1829b5-521d-44e1-a99a-80e0bea5ea65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.184465 Aug 25 03:25:00.114231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 297/586] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:24:59 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:00.552966 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:00.553915 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=8 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:00.614950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-34d4f0db-1af8-4b9c-955f-dccf7083d1c6 req-e48bf7dc-df32-4775-b7cb-4cfd17a1212c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d66607-d18c-4819-a699-018f461be7ec", "name": "network-vif-plugged", "status": "completed", "tag": "981f3602-e4ac-40b3-a185-b66b8fbe7b1b"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:00.626996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-34d4f0db-1af8-4b9c-955f-dccf7083d1c6 req-e48bf7dc-df32-4775-b7cb-4cfd17a1212c service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:00.628445 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-34d4f0db-1af8-4b9c-955f-dccf7083d1c6 req-e48bf7dc-df32-4775-b7cb-4cfd17a1212c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:00.629264 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-34d4f0db-1af8-4b9c-955f-dccf7083d1c6 req-e48bf7dc-df32-4775-b7cb-4cfd17a1212c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:00.644631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-34d4f0db-1af8-4b9c-955f-dccf7083d1c6 req-e48bf7dc-df32-4775-b7cb-4cfd17a1212c service nova] Creating event network-vif-plugged:981f3602-e4ac-40b3-a185-b66b8fbe7b1b for instance 83d66607-d18c-4819-a699-018f461be7ec on hv-cinder-85164 Aug 25 03:25:00.651066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-34d4f0db-1af8-4b9c-955f-dccf7083d1c6 req-e48bf7dc-df32-4775-b7cb-4cfd17a1212c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102203 Aug 25 03:25:00.651066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 290/587] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:00.734086 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:00.734755 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:00.740658 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:00.741141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:00.741729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:00.742612 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:00.743069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:00.743733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:00.879490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:00.887234 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-97252ba6-2fd6-4de6-b604-5c3a515cd278 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.156953 Aug 25 03:25:00.887806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 298/588] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:00 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:01.135848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:01.136543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:01.143141 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:01.143616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:01.144045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:01.144736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:01.145186 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:01.145607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:01.274235 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:01.282409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-93a9e3c8-72e2-49dd-8e1d-09f5d5b8bf30 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.150784 Aug 25 03:25:01.282986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 291/589] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:01 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:01.908285 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:01.909488 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:01.915986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:01.916462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:01.916894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:01.917577 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:01.918026 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:01.918481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:02.043323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:02.050907 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-646d86d5-8087-4990-a800-aa68e6da1e39 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.146436 Aug 25 03:25:02.051492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 299/590] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:01 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:02.304131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:02.304671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:02.311191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:02.314090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:02.314090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:02.314090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:02.314090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:02.315021 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:02.446646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:02.454914 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-061618da-6b8e-4507-aeb4-87cb6d2cb1e4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.154726 Aug 25 03:25:02.455492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 292/591] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:02 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:03.071986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:03.072597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:03.079161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:03.079673 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:03.080119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:03.080840 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:03.081312 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:03.081749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:03.211810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:03.219658 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-00625f83-647c-49f7-adf6-2c6d5cbd5eef tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1367 microversion: 2.1 time: 0.151665 Aug 25 03:25:03.220234 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 300/592] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:03 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:03.475862 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:03.476467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:03.482808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:03.483284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:03.483714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:03.484401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:03.484850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:03.485271 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:03.612943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:03.621060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b5799403-6283-4738-9d8e-a040c54a272f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.149047 Aug 25 03:25:03.621630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 293/593] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:03 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:04.240911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:04.241516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:04.247882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:04.248360 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:04.248795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:04.249475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:04.249922 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:04.250367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:04.388549 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:04.399047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d8f8597f-2ca7-4ee2-ac2b-3db5e2ac9d7e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1557 microversion: 2.1 time: 0.161946 Aug 25 03:25:04.399626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 301/594] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:04 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:04.419463 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:04.419943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:04.426306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:04.426856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:04.427286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:04.427968 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:04.428480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:04.428935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:04.504991 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-583af16b-f59f-40c0-aad4-bccf38605243 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089414 Aug 25 03:25:04.505619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 294/595] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:25:04 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:04.643333 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:04.646748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:04.653001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:04.653478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:04.653904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:04.654636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:04.655078 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:04.655495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:04.932918 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:04.944921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fb51e347-5e55-42a3-b7d1-7f7c8fcc69c3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.305998 Aug 25 03:25:04.945774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 302/596] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:04 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:05.027455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:05.028228 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:05.034787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:05.035273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:05.035910 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:05.036607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:05.037053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:05.037474 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:05.201435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:05.210300 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a88b4ec1-531d-4801-968a-e7a5b7891332 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1594 microversion: 2.1 time: 0.187049 Aug 25 03:25:05.211023 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 295/597] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:05 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1594 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:05.643264 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-4aeb9bce-e381-4784-8faa-0aac5f69f5db req-0ab4b56e-e6c6-4d28-a7f3-05d324cf57ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d66607-d18c-4819-a699-018f461be7ec", "tag": "981f3602-e4ac-40b3-a185-b66b8fbe7b1b"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:05.653756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4aeb9bce-e381-4784-8faa-0aac5f69f5db req-0ab4b56e-e6c6-4d28-a7f3-05d324cf57ae service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:05.654229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4aeb9bce-e381-4784-8faa-0aac5f69f5db req-0ab4b56e-e6c6-4d28-a7f3-05d324cf57ae service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:05.654694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4aeb9bce-e381-4784-8faa-0aac5f69f5db req-0ab4b56e-e6c6-4d28-a7f3-05d324cf57ae service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:05.666383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-4aeb9bce-e381-4784-8faa-0aac5f69f5db req-0ab4b56e-e6c6-4d28-a7f3-05d324cf57ae service nova] Creating event network-changed:981f3602-e4ac-40b3-a185-b66b8fbe7b1b for instance 83d66607-d18c-4819-a699-018f461be7ec on hv-cinder-85164 Aug 25 03:25:05.671853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-4aeb9bce-e381-4784-8faa-0aac5f69f5db req-0ab4b56e-e6c6-4d28-a7f3-05d324cf57ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032088 Aug 25 03:25:05.672777 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 303/598] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:05.967806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:05.968515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:05.975619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:05.980190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:05.980190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:05.980190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:05.980190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:05.980548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:06.477509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:06.487664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c0424d0e-eb27-4af1-8259-4441a8260f50 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.523799 Aug 25 03:25:06.501490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 296/599] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:05 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:07.490441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-a3bbe060-44f4-4e4c-b84e-e6f528cbdcb5 req-daac181f-f6ed-450f-acb4-47ad681f4d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53665120-a0da-4bc4-ab99-311a2ba24558", "tag": "74af88e4-8cbe-453a-8e1b-763221404911"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:07.500216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a3bbe060-44f4-4e4c-b84e-e6f528cbdcb5 req-daac181f-f6ed-450f-acb4-47ad681f4d8a service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:07.503961 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a3bbe060-44f4-4e4c-b84e-e6f528cbdcb5 req-daac181f-f6ed-450f-acb4-47ad681f4d8a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:07.503961 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-a3bbe060-44f4-4e4c-b84e-e6f528cbdcb5 req-daac181f-f6ed-450f-acb4-47ad681f4d8a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:07.509336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:07.509943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:07.513310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-a3bbe060-44f4-4e4c-b84e-e6f528cbdcb5 req-daac181f-f6ed-450f-acb4-47ad681f4d8a service nova] Creating event network-changed:74af88e4-8cbe-453a-8e1b-763221404911 for instance 53665120-a0da-4bc4-ab99-311a2ba24558 on hv-cinder-85164 Aug 25 03:25:07.516382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:07.517068 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:07.518269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:07.519047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:07.519500 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:07.519919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:07.525683 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:07.531009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-a3bbe060-44f4-4e4c-b84e-e6f528cbdcb5 req-daac181f-f6ed-450f-acb4-47ad681f4d8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088924 Aug 25 03:25:07.533863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 304/600] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:07.811751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:07.821703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a6fdc98d-02e4-4bf5-a26a-c04dab0b67cb tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.316108 Aug 25 03:25:07.822653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 297/601] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:07 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:25:08.844708 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:08.845437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:08.853173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:08.853646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:08.854106 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:08.854866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:08.855310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:08.855728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:08.992178 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:08.994757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:09.001626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-55feeffd-54a2-4307-ad1c-f36592930ece tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.161190 Aug 25 03:25:09.002202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 305/602] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:08 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:09.579129 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1931496943"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:09.579666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:09.587850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:09.588332 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:09.588765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:09.589460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:09.589909 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:09.590421 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:09.717188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.network.security_group_api [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Adding security group cf3179d2-ce2c-4618-b883-eb4820f3f3cd to port 74af88e4-8cbe-453a-8e1b-763221404911 Aug 25 03:25:10.022652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:10.023245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:10.030306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:10.030798 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:10.031225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:10.031898 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:10.032342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:10.032753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:10.090697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-998a59b3-eed0-4626-a88f-0df987e92a53 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/action" status: 202 len: 0 microversion: 2.1 time: 0.514929 Aug 25 03:25:10.090697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 298/603] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:25:09 2022] POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:25:10.098243 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:10.098877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:10.104955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:10.105430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:10.105857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:10.107351 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:10.107803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:10.108227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:10.297711 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:10.307617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6ff89912-31c2-48ba-ae59-c809c5fa469c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.288724 Aug 25 03:25:10.308304 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 306/604] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:10 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:25:10.313354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-2f49cda8-d645-49a0-a5a0-6a70a8a0435b req-663e5dea-14d7-4eb5-930e-e37315d63d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53665120-a0da-4bc4-ab99-311a2ba24558", "tag": "74af88e4-8cbe-453a-8e1b-763221404911"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:10.325192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2f49cda8-d645-49a0-a5a0-6a70a8a0435b req-663e5dea-14d7-4eb5-930e-e37315d63d01 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:10.325828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2f49cda8-d645-49a0-a5a0-6a70a8a0435b req-663e5dea-14d7-4eb5-930e-e37315d63d01 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:10.326602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2f49cda8-d645-49a0-a5a0-6a70a8a0435b req-663e5dea-14d7-4eb5-930e-e37315d63d01 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:10.327043 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:10.336748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c68bfd3a-d77e-4e2e-b925-465f9dc19799 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1760 microversion: 2.1 time: 0.242201 Aug 25 03:25:10.339425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-2f49cda8-d645-49a0-a5a0-6a70a8a0435b req-663e5dea-14d7-4eb5-930e-e37315d63d01 service nova] Creating event network-changed:74af88e4-8cbe-453a-8e1b-763221404911 for instance 53665120-a0da-4bc4-ab99-311a2ba24558 on hv-cinder-85164 Aug 25 03:25:10.343088 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 299/605] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:10 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1760 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:25:10.353329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-2f49cda8-d645-49a0-a5a0-6a70a8a0435b req-663e5dea-14d7-4eb5-930e-e37315d63d01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043627 Aug 25 03:25:10.354572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 307/606] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:11.331759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:11.332355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:11.339736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:11.340212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:11.340642 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:11.341324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:11.341770 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:11.342191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:11.471692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:11.479903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-90f65bab-38eb-441e-940e-5a0e0dd55efa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.151965 Aug 25 03:25:11.480478 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 300/607] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:11 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:12.502669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:12.503287 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:12.509413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:12.509891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:12.510353 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:12.511043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:12.511492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:12.511913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:12.639408 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:12.648216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cffc5c11-4e52-400c-8c83-ea6836024710 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.150915 Aug 25 03:25:12.648790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 308/608] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:12 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:13.668980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:13.669584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:13.676530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:13.676999 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:13.677423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:13.678096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:13.678567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:13.678981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:13.810564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:13.820680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-189d3947-9281-40ac-8a8a-afa7369b7f65 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.155574 Aug 25 03:25:13.821269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 301/609] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:13 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:14.841646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:14.842204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:14.849216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:14.849694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:14.850132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:14.850844 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:14.851311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:14.851721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:14.980516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:14.989432 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0fb8f6f4-8051-4649-992b-c675ad5f844c tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.151718 Aug 25 03:25:14.990003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 309/610] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:14 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:16.010776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:16.011417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:16.017377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:16.017845 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:16.018271 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:16.018975 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:16.019421 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:16.019840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:16.152749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:16.158664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6214ca3c-e620-4732-b632-a09ec92439c2 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.151814 Aug 25 03:25:16.159168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 302/611] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:16 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:17.179731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:17.180329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:17.182764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:17.187384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:17.187853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:17.188280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:17.188959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:17.189902 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:17.190339 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:17.319852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:17.328212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f03b48fb-5af3-4b9e-bbb9-89ec914a5d71 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.152300 Aug 25 03:25:17.328779 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 310/612] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:17 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:18.350386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:18.350991 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:18.357474 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:18.357949 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:18.358419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:18.359116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:18.359568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:18.360042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:18.488302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:18.497473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-00d57fb6-160e-4ba2-84cb-f9bdb5a01dc4 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.151015 Aug 25 03:25:18.498042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 303/613] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:18 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:19.519869 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:19.520466 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:19.527407 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:19.527875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:19.528301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:19.528973 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:19.529415 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:19.529827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:19.660875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:19.669048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-914cd4d4-de80-467d-8a3e-7d58653c0a12 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.153791 Aug 25 03:25:19.669618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 311/614] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:19 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:20.691551 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:20.692158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:20.699086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:20.699560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:20.699989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:20.700681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:20.701129 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:20.701547 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:20.836778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:20.844905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1ff3761c-82ca-4054-a38a-5132214642aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.157567 Aug 25 03:25:20.845476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 304/615] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:20 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:21.864997 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:21.865529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:21.871946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:21.872420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:21.872851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:21.873528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:21.873975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:21.874414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:22.002242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:22.010414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e52a287e-b1e4-4b3e-8980-ce2e56888f37 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1734 microversion: 2.1 time: 0.149378 Aug 25 03:25:22.010984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 312/616] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:21 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:23.031812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:23.032423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:23.035314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=44 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:23.040002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.040529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.040962 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.041646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.042094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.042543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.173097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:23.182058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c88d3451-0e5e-4289-8c4f-07e1fc967f08 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1714 microversion: 2.1 time: 0.153987 Aug 25 03:25:23.182642 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 305/617] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:23 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:23.245805 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:23.246325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:23.252816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.253325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.253762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.254492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.254947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.255371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.376226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] HTTP exception thrown: Cannot 'detach_volume' instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 while it is in vm_state rescued Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Request method failure captured: Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments/b93a3d89-4929-4cad-9382-9860bf26047a HTTP/1.1 Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuokvio5MAixDZYM2euCbL_fTjJk82CeD55b7xEUH87akmz6n46pEBabt24-P2Sd-52Y9x0Y-c2jIfTMrW6wstMY4aBYnbVx9GD_UJWoSemlxT_0P_efCgouKwRgI-lOkTvYmIQWkUrAwYwO2Yk9h4StfingqGT4FXZ_BEKqDvGKCNo Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:25:23.377828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d0928e519ec247b988a254d7918cbfed"}]}] Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: c7dc5019b26a4a8abf6436be3f1e56af Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:25:23.379572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Cannot 'detach_volume' instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 while it is in vm_state rescued Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'server_id': 'e2e2d76b-15ac-4d15-bd62-9835364dabc3', 'id': 'b93a3d89-4929-4cad-9382-9860bf26047a'} Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:25:23.380421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 while it is in vm_state rescued Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 while it is in vm_state rescued Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:25:23.382039 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Returning 409 to user: Cannot 'detach_volume' instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 while it is in vm_state rescued {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:25:23.383329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9c8ef4c1-31fc-4cc3-9105-a0d7aeb11da8 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments/b93a3d89-4929-4cad-9382-9860bf26047a" status: 409 len: 152 microversion: 2.1 time: 0.137530 Aug 25 03:25:23.383329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 313/618] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:25:23 2022] DELETE /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments/b93a3d89-4929-4cad-9382-9860bf26047a => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 03:25:23.388327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:23.388929 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:23.395236 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.395765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.396212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.397007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.397453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.397868 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.571518 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-97e498df-6126-4286-a59d-7154bad8a1a5 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "POST /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/action" status: 202 len: 0 microversion: 2.1 time: 0.186791 Aug 25 03:25:23.572126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 306/619] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:25:23 2022] POST /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:25:23.581037 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:23.582808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:23.588943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.589421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.589848 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.590570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.591014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.591427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.751384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:23.761271 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-04ad23cd-6161-4734-bb3b-a6328d21c0aa tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1722 microversion: 2.1 time: 0.184320 Aug 25 03:25:23.762436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 314/620] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:23 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:24.783581 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:24.784276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:24.791298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:24.791773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:24.792203 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:24.792886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:24.793331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:24.793747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:24.927841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:24.936096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6f525298-0023-48a0-bc93-69a02b3f486a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1722 microversion: 2.1 time: 0.156690 Aug 25 03:25:24.936667 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 307/621] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:24 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:25.956959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:25.957569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:25.964042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:25.964519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:25.964957 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:25.965638 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:25.966088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:25.966547 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:26.097579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:26.105749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-64cb3536-bc6b-4a8a-a8ef-f762d01e1fe3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1722 microversion: 2.1 time: 0.152661 Aug 25 03:25:26.106363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 315/622] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:25 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:26.194473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:26.195018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:26.202230 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:26.202744 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:26.203355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:26.204286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:26.204800 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:26.205228 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:26.326525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lazy-loading 'services' on Instance uuid a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:25:26.544593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d2d51a8a-cc67-4bc8-9f4b-79cdc6e38ca9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-volume_attachments/9a898187-290a-46f9-b527-0c6fa68b998e" status: 202 len: 0 microversion: 2.1 time: 0.355822 Aug 25 03:25:26.545099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 308/623] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:25:26 2022] DELETE /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-volume_attachments/9a898187-290a-46f9-b527-0c6fa68b998e => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:25:27.131970 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:27.131970 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:27.135067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:27.135552 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:27.135989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:27.136678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:27.137165 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:27.137609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:27.263601 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:27.271706 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-32c80174-94e8-440f-9b70-57e6803ddb2f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1722 microversion: 2.1 time: 0.148480 Aug 25 03:25:27.272270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 316/624] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:27 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:28.293842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:28.294567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:28.301458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.301934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.302385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.303496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.303956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.304539 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.438094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:28.447070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fed9e76f-1ffe-4c77-b6c5-3f8ea7104be1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1728 microversion: 2.1 time: 0.157992 Aug 25 03:25:28.447647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 309/625] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:28 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:28.480197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:28.480681 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:28.486878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.487362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.487803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.488480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.488926 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.489348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.566472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f6871ab0-04b5-4477-a816-2e185bee8860 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090563 Aug 25 03:25:28.567091 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 317/626] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:25:28 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:29.774471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-176fbe5d-fe96-4fa9-989a-babd2bd6c09b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:29.782664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-176fbe5d-fe96-4fa9-989a-babd2bd6c09b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:29.783269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-176fbe5d-fe96-4fa9-989a-babd2bd6c09b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:29.783804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-176fbe5d-fe96-4fa9-989a-babd2bd6c09b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:29.810846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-176fbe5d-fe96-4fa9-989a-babd2bd6c09b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Going to try to stop instance {{(pid=121278) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 03:25:29.813937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-06c3e17f-34a0-404a-86c8-5415c3816657 req-2aeacfb3-aa2d-44ff-8a60-31b78ce0e924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e2d76b-15ac-4d15-bd62-9835364dabc3", "tag": "c45badac-76ed-40f5-ace2-d566d6e55505"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:29.826104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-06c3e17f-34a0-404a-86c8-5415c3816657 req-2aeacfb3-aa2d-44ff-8a60-31b78ce0e924 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:29.826694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-06c3e17f-34a0-404a-86c8-5415c3816657 req-2aeacfb3-aa2d-44ff-8a60-31b78ce0e924 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:29.827308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-06c3e17f-34a0-404a-86c8-5415c3816657 req-2aeacfb3-aa2d-44ff-8a60-31b78ce0e924 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:29.842728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-06c3e17f-34a0-404a-86c8-5415c3816657 req-2aeacfb3-aa2d-44ff-8a60-31b78ce0e924 service nova] Creating event network-changed:c45badac-76ed-40f5-ace2-d566d6e55505 for instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 on hv-cinder-85164 Aug 25 03:25:29.847870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-06c3e17f-34a0-404a-86c8-5415c3816657 req-2aeacfb3-aa2d-44ff-8a60-31b78ce0e924 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039188 Aug 25 03:25:29.848469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 318/627] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:25:30.001939 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-176fbe5d-fe96-4fa9-989a-babd2bd6c09b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action" status: 202 len: 0 microversion: 2.1 time: 0.231069 Aug 25 03:25:30.004660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 310/628] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:25:29 2022] POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:25:30.012504 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:30.013197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:30.020409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:30.020884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:30.021662 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:30.022485 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:30.023180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:30.023663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:30.162255 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:30.170416 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6a4bc627-b517-4905-bad4-ca299c6df66d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.162022 Aug 25 03:25:30.170998 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 319/629] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:30 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:31.195075 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:31.195779 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:31.202201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:31.202709 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:31.203146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:31.203864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:31.204317 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:31.204739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:31.223707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:31.338399 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:31.345944 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b8b20f99-51eb-49d6-9f31-1264c2317743 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.156709 Aug 25 03:25:31.346550 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 311/630] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:31 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:31.862833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-7559a64d-a941-41a0-ae9c-3811b3ac2c23 req-c70c2dc0-a6cb-42f7-b213-64f84a4d3ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e2d76b-15ac-4d15-bd62-9835364dabc3", "tag": "c45badac-76ed-40f5-ace2-d566d6e55505"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:31.872525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7559a64d-a941-41a0-ae9c-3811b3ac2c23 req-c70c2dc0-a6cb-42f7-b213-64f84a4d3ec7 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:31.872984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7559a64d-a941-41a0-ae9c-3811b3ac2c23 req-c70c2dc0-a6cb-42f7-b213-64f84a4d3ec7 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:31.873399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7559a64d-a941-41a0-ae9c-3811b3ac2c23 req-c70c2dc0-a6cb-42f7-b213-64f84a4d3ec7 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:31.884740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-7559a64d-a941-41a0-ae9c-3811b3ac2c23 req-c70c2dc0-a6cb-42f7-b213-64f84a4d3ec7 service nova] Creating event network-changed:c45badac-76ed-40f5-ace2-d566d6e55505 for instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 on hv-cinder-85164 Aug 25 03:25:31.889516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-7559a64d-a941-41a0-ae9c-3811b3ac2c23 req-c70c2dc0-a6cb-42f7-b213-64f84a4d3ec7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030964 Aug 25 03:25:31.890080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 320/631] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:32.366812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:32.367423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:32.373810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:32.374306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:32.374754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:32.375450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:32.375902 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:32.376333 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:32.528522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:32.536867 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7ed73ebe-dbe2-4cc4-9bf7-ece5efbcd669 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.173902 Aug 25 03:25:32.537434 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 312/632] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:32 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:33.558042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:33.558696 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:33.564782 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:33.565263 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:33.565960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:33.567036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:33.567140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:33.567525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:33.698582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:33.706189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e4d2fdf4-a3a1-47ad-a350-231d9a1615d2 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.152896 Aug 25 03:25:33.706790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 321/633] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:33 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:34.727227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:34.727833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:34.734376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:34.734851 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:34.735278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:34.735959 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:34.736406 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:34.737833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:34.868019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:34.875997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4f9f5d01-8ebe-436e-af15-b8006e73f1ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.152806 Aug 25 03:25:34.876567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 313/634] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:34 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:35.899544 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:35.900084 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:35.906472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:35.906949 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:35.907384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:35.908065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:35.908512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:35.908941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:36.037428 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:36.045069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-15046ba9-5e4b-4513-b0c4-b7c1badc34b7 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.149436 Aug 25 03:25:36.045636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 322/635] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:35 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:37.067185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:37.067820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:37.074229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:37.074736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:37.075174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:37.075855 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:37.076303 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:37.076722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:37.205739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:37.213334 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-24e609f6-f2bb-4ebe-84fc-12f5a17d7ceb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.150872 Aug 25 03:25:37.213904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 314/636] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:37 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:38.234585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:38.235190 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:38.241656 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:38.242125 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:38.242588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:38.243264 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:38.243707 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:38.244121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:38.370736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:38.379069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d626744c-2674-4e33-8988-0fc89dada805 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.148426 Aug 25 03:25:38.379647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 323/637] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:38 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:39.399428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:39.400033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:39.406523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:39.406999 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:39.407433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:39.408113 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:39.408560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:39.409642 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:39.539468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:39.547142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-dc500242-f478-4e6c-a0be-5102a62b75c3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.151576 Aug 25 03:25:39.547704 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 315/638] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:39 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:40.568510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:40.569066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:40.575934 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:40.576414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:40.577000 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:40.577734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:40.578192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:40.578649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:40.581956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=96 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:40.708940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:40.716642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-393eb62c-a1fb-4974-a7c0-be3e7e863252 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.152362 Aug 25 03:25:40.717217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 324/639] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:40 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:41.738662 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:41.739274 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:41.746225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:41.746734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:41.747169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:41.747860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:41.748312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:41.748736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:41.908384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:41.908384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5136f12d-8540-4b52-9587-5c370722bc42 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.172521 Aug 25 03:25:41.908384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 316/640] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:41 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:42.928550 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:42.929153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:42.935648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:42.936124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:42.936551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:42.937230 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:42.937675 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:42.938089 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:43.065941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:43.073574 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1a2df379-f207-4681-8038-315fd61a1ce1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.149368 Aug 25 03:25:43.074142 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 325/641] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:42 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:44.093947 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:44.094569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:44.100751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:44.101230 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:44.101669 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:44.102378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:44.102830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:44.103253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:44.228905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:44.236471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5fc05df5-0bef-4dc5-844a-02dc362b811b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.146368 Aug 25 03:25:44.237042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 317/642] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:44 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:45.256822 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:45.257461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:45.263912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:45.264384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:45.264811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:45.265486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:45.265931 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:45.266380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:45.396885 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:45.404610 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-843868a8-ea62-48f1-8a2e-2640300ce775 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1678 microversion: 2.1 time: 0.151629 Aug 25 03:25:45.405183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 326/643] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:45 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:46.426645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:46.427259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:46.433648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:46.434121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:46.434582 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:46.435268 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:46.435710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:46.436156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:46.563164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:46.571086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1f4fc7b7-c552-4dde-b4b7-f7109f04c8a8 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1655 microversion: 2.1 time: 0.148888 Aug 25 03:25:46.571660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 318/644] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:46 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:46.591752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87a1352d-e586-4812-a4b9-46403072edc9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:46.598818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87a1352d-e586-4812-a4b9-46403072edc9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:46.599296 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87a1352d-e586-4812-a4b9-46403072edc9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:46.599738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87a1352d-e586-4812-a4b9-46403072edc9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:46.620972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-87a1352d-e586-4812-a4b9-46403072edc9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Going to try to start instance {{(pid=121277) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 03:25:46.776105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-87a1352d-e586-4812-a4b9-46403072edc9 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action" status: 202 len: 0 microversion: 2.1 time: 0.187911 Aug 25 03:25:46.776624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 327/645] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:25:46 2022] POST /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:25:46.785459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:46.789964 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:46.791959 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:46.792438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:46.792876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:46.793571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:46.794024 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:46.794496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:46.926525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:46.934107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9fb62060-9d0e-4e39-8b61-b3796289b37f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1664 microversion: 2.1 time: 0.153162 Aug 25 03:25:46.934707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 319/646] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:46 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:47.956308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:47.957032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:47.958954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=36 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:47.963694 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:47.964175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:47.964607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:47.965288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:47.965738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:47.966161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:48.094905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:48.103176 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8567208f-5760-4dab-b4ae-ac7d6dfca76d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1664 microversion: 2.1 time: 0.151541 Aug 25 03:25:48.103745 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 328/647] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:47 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:49.124352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:49.124968 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:49.132040 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:49.132517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:49.132952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:49.133638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:49.134088 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:49.134537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:49.260377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:49.267991 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1fa7d969-0e9d-4570-b2a8-4d35a618ad0c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1668 microversion: 2.1 time: 0.147470 Aug 25 03:25:49.268566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 320/648] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:49 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:10.443651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:10.444251 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:10.446995 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:10.447644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:10.452318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:10.452795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:10.453231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:10.453937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:10.454422 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:10.459373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:10.479725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:26:10.692928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ee53e8bd-b757-4886-b64f-0575b2301ab1 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 204 len: 0 microversion: 2.1 time: 0.253026 Aug 25 03:26:10.693594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 329/649] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:26:10 2022] DELETE /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:26:10.702320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:10.702888 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:10.706420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=31 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:10.710418 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=56 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:10.711883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:10.712355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:10.712784 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:10.713504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:10.713954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:10.714417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:10.846185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:10.853887 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0c411c8d-4620-42dd-8edc-6a4d4db4dfed tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1576 microversion: 2.1 time: 0.156016 Aug 25 03:26:10.854490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 321/650] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:10 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:11.875968 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:11.876608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:11.883597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:11.884065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:11.884489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:11.885160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:11.885603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:11.886015 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:12.015193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:12.023566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f68e7448-5b68-4c95-8ecc-adde788c6995 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1576 microversion: 2.1 time: 0.151953 Aug 25 03:26:12.024133 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 330/651] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:11 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:13.044453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:13.045065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:13.051553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:13.061288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:13.061288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:13.061288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:13.061288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:13.061691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:13.270570 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:13.278348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3cdd1904-d8c3-4089-985d-c05bcf9909e6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1576 microversion: 2.1 time: 0.237702 Aug 25 03:26:13.278928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 322/652] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:13 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:14.167397 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-043d001b-e666-44c1-8d02-58e6f6c6552d req-869d166b-61f9-4f77-8c93-576ec69e153e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733fa4c6-b3ef-4350-a501-bbebf3ce0a19", "name": "network-vif-deleted", "tag": "fd31addb-9fdc-40a4-8da4-6a52ce36791d"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:14.178720 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-043d001b-e666-44c1-8d02-58e6f6c6552d req-869d166b-61f9-4f77-8c93-576ec69e153e service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:14.180972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-043d001b-e666-44c1-8d02-58e6f6c6552d req-869d166b-61f9-4f77-8c93-576ec69e153e service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:14.180972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-043d001b-e666-44c1-8d02-58e6f6c6552d req-869d166b-61f9-4f77-8c93-576ec69e153e service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:14.191771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-043d001b-e666-44c1-8d02-58e6f6c6552d req-869d166b-61f9-4f77-8c93-576ec69e153e service nova] Creating event network-vif-deleted:fd31addb-9fdc-40a4-8da4-6a52ce36791d for instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 on hv-cinder-85164 Aug 25 03:26:14.196976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-043d001b-e666-44c1-8d02-58e6f6c6552d req-869d166b-61f9-4f77-8c93-576ec69e153e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033457 Aug 25 03:26:14.197825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 331/653] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:14.300201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:14.300848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:14.307508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:14.307994 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:14.308430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:14.309272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:14.309728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:14.310435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:14.386710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:14.402445 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d0ff1534-b627-457d-b4d2-38e59dedc553 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1225 microversion: 2.1 time: 0.106352 Aug 25 03:26:14.404677 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 323/654] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:14 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:15.426173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:15.426928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:15.433585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:15.436240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:15.436240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:15.436240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:15.436240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:15.436633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:15.471974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:15.472369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:15.473386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:15.473833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lazy-loading 'fault' on Instance uuid 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:26:15.518235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:15.526317 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0ccc4abd-1528-417b-8a7c-221bf5eebdc4 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 200 len: 1230 microversion: 2.1 time: 0.104940 Aug 25 03:26:15.540129 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 332/655] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:15 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:26:16.547682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:16.548252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:16.554509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:16.554979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:16.555400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:16.556075 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:16.556517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:16.556929 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:16.570100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] HTTP exception thrown: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Request method failure captured: Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 HTTP/1.1 Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBurUKuv2wxg5XM7xKWeTmTFXR29aMl7TU7ZNe6r-xpNxsYacsp9W7_RMs8pxlpsrCPLW-fBVsaYVWMsLpNZt87713IVo1hcE-ZR_KEan-dMXvNFNXXpjpDolIYFWh7sn_e04S76ZslaW-l5C4liKr-7ZOmGGW6lO5eyC4RLKAHHPqe8 Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:26:16.571728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d445535a4974186a835ab117109dca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d445535a4974186a835ab117109dca1"}]}] Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: d0a0e9c327564a3db8b89ea706f0fb36 Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:26:16.573372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '733fa4c6-b3ef-4350-a501-bbebf3ce0a19'} Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:26:16.574525 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:26:16.576109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:16.577488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Returning 404 to user: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:26:16.577488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-20ceff36-6e18-4923-bf9d-e600ea6532a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 404 len: 111 microversion: 2.1 time: 0.029351 Aug 25 03:26:16.577488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 324/656] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:16 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:26:16.674352 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1444489074", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-906870696", "security_groups": [{"name": "tempest-secgroup-smoke-124869442"}], "block_device_mapping_v2": [{"uuid": "666511fc-dcaf-4302-b780-d5a3893f2512", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "444723d5-7c16-4c26-8712-31f648699b2b"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:16.786016 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] validate_networks() for [('444723d5-7c16-4c26-8712-31f648699b2b', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:26:17.147292 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:26:17.147717 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:26:17.148188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:26:17.148596 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:26:17.149005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:26:17.157801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:17.158319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:17.158742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:17.159463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:17.159916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:17.160338 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:17.176645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for project 5d445535a4974186a835ab117109dca1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:26:17.180564 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for user d0a0e9c327564a3db8b89ea706f0fb36 and project 5d445535a4974186a835ab117109dca1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:26:17.236407 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:26:17.238566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='666511fc-dcaf-4302-b780-d5a3893f2512',volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:26:17.584566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-78bc600a-c005-41eb-98ab-410cabaacc00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914099 Aug 25 03:26:17.585313 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 333/657] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:26:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:26:17.596132 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-74c6b2ab-c077-42fb-b50a-78a2ce2ba3c5 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:17.596722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-74c6b2ab-c077-42fb-b50a-78a2ce2ba3c5 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:17.651273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-74c6b2ab-c077-42fb-b50a-78a2ce2ba3c5 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:17.658089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-74c6b2ab-c077-42fb-b50a-78a2ce2ba3c5 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1094 microversion: 2.1 time: 0.065954 Aug 25 03:26:17.658684 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 325/658] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:17 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:18.679122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:18.679731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:18.686374 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:18.686861 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:18.687298 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:18.688057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:18.688478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:18.688901 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:18.749848 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:18.758022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-90b312ad-d5eb-4b61-aaf3-c94260ede587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1144 microversion: 2.1 time: 0.083560 Aug 25 03:26:18.758616 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 334/659] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:18 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:19.779737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:19.785683 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:19.788062 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:19.788534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:19.789346 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:19.790161 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:19.791167 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:19.791590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:19.856815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:19.864636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1bd5f446-cfda-479f-a820-443304c5765f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1210 microversion: 2.1 time: 0.089500 Aug 25 03:26:19.865242 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 326/660] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:19 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:20.884836 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:20.888956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:20.892951 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:20.893439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:20.894014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:20.894904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:20.895367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:20.895807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:21.101980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:21.109861 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3970dadd-de15-42b5-9d54-6ca6f258334d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1277 microversion: 2.1 time: 0.228866 Aug 25 03:26:21.110531 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 335/661] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:20 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:21.205596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-6cc6adc9-b5c2-47bf-b9bd-d007ecbff7d0 req-4b6d6f02-3164-42ef-8b49-abcd8ea17d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d0cce0-fa6b-4e6c-a631-49e182a7c001", "tag": "9c589d51-6feb-4258-869a-68069ebde8f1"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:21.217005 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-6cc6adc9-b5c2-47bf-b9bd-d007ecbff7d0 req-4b6d6f02-3164-42ef-8b49-abcd8ea17d05 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:21.217482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-6cc6adc9-b5c2-47bf-b9bd-d007ecbff7d0 req-4b6d6f02-3164-42ef-8b49-abcd8ea17d05 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:21.217928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-6cc6adc9-b5c2-47bf-b9bd-d007ecbff7d0 req-4b6d6f02-3164-42ef-8b49-abcd8ea17d05 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:21.230662 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-6cc6adc9-b5c2-47bf-b9bd-d007ecbff7d0 req-4b6d6f02-3164-42ef-8b49-abcd8ea17d05 service nova] Creating event network-changed:9c589d51-6feb-4258-869a-68069ebde8f1 for instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 on hv-cinder-85164 Aug 25 03:26:21.235823 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-6cc6adc9-b5c2-47bf-b9bd-d007ecbff7d0 req-4b6d6f02-3164-42ef-8b49-abcd8ea17d05 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033718 Aug 25 03:26:21.237009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 327/662] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:21.404628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:21.407074 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:21.413606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:21.414079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:21.414535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:21.415258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:21.415703 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:21.416119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:21.639396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d41162dc-786a-430f-87d3-7210669bfdf9 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/action" status: 202 len: 0 microversion: 2.1 time: 0.238411 Aug 25 03:26:21.640208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 336/663] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:26:21 2022] POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:26:21.650572 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:21.651267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:21.657321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:21.657819 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:21.658215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:21.658951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:21.659566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:21.659980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:21.883466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:21.892748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b4997ba9-affd-4540-8f5b-558e639c4983 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1752 microversion: 2.1 time: 0.247135 Aug 25 03:26:21.893432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 328/664] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:21 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:22.132196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:22.132981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:22.139231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:22.139795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:22.140317 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:22.141077 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:22.141602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:22.142113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:22.286135 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:22.294705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d591c841-9972-4997-97d1-83144299977a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.167849 Aug 25 03:26:22.295459 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 337/665] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:22 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:22.914792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:22.915446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:22.921833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:22.922344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:22.922791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:22.923469 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:22.923921 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:22.924344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:23.061397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:23.070436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-720294d7-e9cf-4ff8-9865-f6b2f778e1dc tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1752 microversion: 2.1 time: 0.159474 Aug 25 03:26:23.071003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 329/666] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:22 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:23.318384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:23.319019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:23.325613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:23.326096 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:23.326569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:23.327261 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:23.327712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:23.328162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:23.461938 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:23.469722 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7e4806cb-eb9c-45d5-b068-84404e4ae68d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.156357 Aug 25 03:26:23.470327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 338/667] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:23 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:24.092095 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:24.092712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:24.099768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:24.100235 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:24.100657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:24.101329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:24.101768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:24.102181 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:24.240859 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:24.248973 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0dbc203d-c5c2-492c-b0f0-a6e66c7ffb7e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.160826 Aug 25 03:26:24.249544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 330/668] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:24 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:24.489159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:24.489770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:24.496313 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:24.496780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:24.497201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:24.497869 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:24.498328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:24.498852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:24.630462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:24.638293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-70f001a9-0d50-4e5f-ab62-206ec4077cb3 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.152879 Aug 25 03:26:24.638891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 339/669] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:24 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:25.270573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:25.271177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:25.277637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:25.278104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:25.278555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:25.279236 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:25.279677 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:25.280086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:25.417806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:25.427213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cd3b461e-bcb2-432f-9b3f-3823e07a217e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.160292 Aug 25 03:26:25.428585 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 331/670] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:25 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:25.658448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:25.659058 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:25.666098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:25.666602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:25.667031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:25.667742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:25.668192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:25.668612 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:25.799285 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:25.806943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9676049f-ac25-4eea-8da6-21dcc26135fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.152391 Aug 25 03:26:25.807512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 340/671] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:25 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:26.450537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:26.451154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:26.459973 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:26.460819 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:26.461345 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:26.462056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:26.462534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:26.462963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:26.602055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:26.610221 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-423f0122-7743-4260-a667-439c109b6021 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.164788 Aug 25 03:26:26.610808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 332/672] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:26 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:26.827597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:26.828155 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:26.834881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:26.835471 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:26.835936 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:26.836628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:26.837078 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:26.837499 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:26.964863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:26.973138 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3226a396-c6c9-46b8-82ab-666ce3f37f42 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.149512 Aug 25 03:26:26.973717 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 341/673] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:26 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:27.632088 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:27.632700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:27.639295 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:27.639773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:27.640201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:27.640912 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:27.641360 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:27.641779 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:27.658353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:27.786124 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:27.796630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-02e2b51e-d975-408d-ad4d-20aca39bddde tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.168223 Aug 25 03:26:27.797002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 333/674] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:27 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:27.993389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:27.994031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:27.996020 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:27.996688 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:28.001989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:28.002518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:28.002954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:28.004351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:28.004807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:28.005231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:28.141283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:28.149137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bf929def-2f59-44d4-8b8e-df74a7bb996a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.159545 Aug 25 03:26:28.149718 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 342/675] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:27 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:28.817612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:28.823382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:28.824888 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:28.825358 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:28.825788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:28.826544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:28.826993 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:28.827442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:28.970303 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:28.978424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f64e0d1e-4adc-4e5c-b631-fbf6a9d15d36 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.165004 Aug 25 03:26:28.979008 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 334/676] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:28 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:29.170097 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:29.170679 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:29.177109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:29.177589 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:29.178023 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:29.178737 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:29.179191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:29.179627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:29.306481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:29.309818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:29.314581 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-aa9a080c-b65c-4605-93d7-50c24664d2c9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.148043 Aug 25 03:26:29.322498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 343/677] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:29 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:29.999417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:30.000026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:30.006452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:30.006931 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:30.007366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:30.008055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:30.008502 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:30.008922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:30.148307 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:30.156369 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c46a257b-e1cd-41e5-bae4-f81d497a95a3 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.160867 Aug 25 03:26:30.156929 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 335/678] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:29 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:30.341465 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:30.341992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:30.349754 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:30.350228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:30.350679 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:30.351362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:30.351811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:30.352231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:30.483894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:30.491529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-981c7eb8-0046-4064-8e88-f79bfc2b7ffd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.154207 Aug 25 03:26:30.492095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 344/679] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:30 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:31.178162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:31.178822 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:31.185421 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:31.185899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:31.186359 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:31.187046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:31.187488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:31.187904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:31.326859 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:31.334872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1453c610-4936-4022-aa53-94b9fad1e916 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.161173 Aug 25 03:26:31.335440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 336/680] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:31 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:31.512028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:31.512627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:31.520081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:31.520491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:31.520911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:31.521642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:31.522081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:31.522515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:31.658183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:31.666615 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2d4abfb9-aba6-4f99-b36f-47996b1cf5a9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.158428 Aug 25 03:26:31.667186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 345/681] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:31 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:32.356446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:32.357096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:32.363937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:32.364415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:32.364848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:32.365533 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:32.365982 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:32.366437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:32.504392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:32.512513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a9f16def-2129-4f55-8ef6-8c0db5db8ce1 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.159994 Aug 25 03:26:32.513093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 337/682] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:32 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:32.685992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:32.686618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:32.693395 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:32.693860 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:32.694303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:32.695050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:32.695495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:32.695939 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:32.833848 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:32.841594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-31c7b2b9-674d-4397-a9f8-28fde5b0ed16 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.159398 Aug 25 03:26:32.842170 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 346/683] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:32 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:33.532958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:33.533567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:33.539980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:33.540451 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:33.540881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:33.541573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:33.542021 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:33.542478 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:33.688515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:33.697448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7a2a931e-1848-4762-8079-c36fcc8ba3a5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.168371 Aug 25 03:26:33.698028 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 338/684] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:33 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:33.863137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:33.863753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:33.870223 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:33.870735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:33.871172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:33.871963 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:33.872504 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:33.872928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:34.001611 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:34.009914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ed432d9b-cc7d-4d9d-9e4a-80563a515a22 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.151258 Aug 25 03:26:34.010526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 347/685] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:33 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:34.717750 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:34.718399 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:34.726936 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:34.727470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:34.727965 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:34.729125 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:34.729831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:34.730265 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:34.872793 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:34.876197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:34.881241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-91cb6311-5f04-4d08-abd6-a9387a2eda57 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.167336 Aug 25 03:26:34.881814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 339/686] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:34 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:35.030647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:35.031264 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:35.037785 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:35.038302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:35.038728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:35.039417 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:35.039865 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:35.040285 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:35.171365 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:35.179159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-35ab6c48-935a-47db-a8a4-ea538749466b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.152369 Aug 25 03:26:35.179728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 348/687] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:35 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:35.295576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-4ecf0079-ab56-44a0-8a4b-436e7d0b94d6 req-9d44097b-c6eb-4dc9-baad-23a3d9e7379b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d0cce0-fa6b-4e6c-a631-49e182a7c001", "name": "network-vif-plugged", "status": "completed", "tag": "9c589d51-6feb-4258-869a-68069ebde8f1"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:35.305716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-4ecf0079-ab56-44a0-8a4b-436e7d0b94d6 req-9d44097b-c6eb-4dc9-baad-23a3d9e7379b service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:35.306311 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-4ecf0079-ab56-44a0-8a4b-436e7d0b94d6 req-9d44097b-c6eb-4dc9-baad-23a3d9e7379b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:35.306722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-4ecf0079-ab56-44a0-8a4b-436e7d0b94d6 req-9d44097b-c6eb-4dc9-baad-23a3d9e7379b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:35.318777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-4ecf0079-ab56-44a0-8a4b-436e7d0b94d6 req-9d44097b-c6eb-4dc9-baad-23a3d9e7379b service nova] Creating event network-vif-plugged:9c589d51-6feb-4258-869a-68069ebde8f1 for instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 on hv-cinder-85164 Aug 25 03:26:35.324049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-4ecf0079-ab56-44a0-8a4b-436e7d0b94d6 req-9d44097b-c6eb-4dc9-baad-23a3d9e7379b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Aug 25 03:26:35.324647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 340/688] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:35.902747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:35.903371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:35.909935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:35.912003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:35.912003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:35.912003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:35.912003 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:35.912447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:36.057345 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:36.065793 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-72001d6e-7a8f-4d07-8456-891e42349622 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1757 microversion: 2.1 time: 0.166961 Aug 25 03:26:36.066563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 349/689] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:35 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:36.201871 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:36.202516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:36.209072 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:36.209546 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:36.209976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:36.210685 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:36.211135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:36.211555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:36.341086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:36.349647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6a2251cf-5523-4bbb-a269-eff6c678ab1d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.152514 Aug 25 03:26:36.350257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 341/690] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:36 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:37.087603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:37.088254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:37.094647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:37.095124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:37.095556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:37.096241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:37.096691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:37.097337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:37.235150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:37.249497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e8a7d238-f03d-4a26-844f-d823ff462d20 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1760 microversion: 2.1 time: 0.166252 Aug 25 03:26:37.250098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 350/691] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:37 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:37.370321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:37.370839 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:37.378516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:37.379197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:37.379856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:37.381081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:37.381907 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:37.382846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:37.515396 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:37.523590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5139c8d8-d457-40a1-921f-8af5ae3c1fcf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.157345 Aug 25 03:26:37.524157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 342/692] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:37 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:38.544607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:38.545211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:38.552201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:38.552667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:38.553087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:38.553761 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:38.554204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:38.554640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:38.687294 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:38.695228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-430b5b9c-acfb-4cbf-bc2b-55153137ab92 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1265 microversion: 2.1 time: 0.154478 Aug 25 03:26:38.695798 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 351/693] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:38 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:39.715892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:39.716490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:39.723255 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:39.723805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:39.724216 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:39.724890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:39.725362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:39.725782 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:39.857925 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:39.866215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-dbd5e3fa-575c-480f-949c-4039a4b86839 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1452 microversion: 2.1 time: 0.154174 Aug 25 03:26:39.869804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 343/694] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:39 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:39.886684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:39.887289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:39.893340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:39.893815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:39.894243 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:39.894952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:39.895401 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:39.895822 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:40.025132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:40.032905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e4223be6-b5ed-4cd7-8d84-ba11a7d963ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1452 microversion: 2.1 time: 0.150024 Aug 25 03:26:40.033473 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 352/695] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:39 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:41.946383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-d7305d96-b42e-4788-a7a8-98f7c9348f89 req-8a70727e-6035-4eec-b9e6-8d099df03453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d0cce0-fa6b-4e6c-a631-49e182a7c001", "tag": "9c589d51-6feb-4258-869a-68069ebde8f1"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:41.952966 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=49 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:41.958314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-d7305d96-b42e-4788-a7a8-98f7c9348f89 req-8a70727e-6035-4eec-b9e6-8d099df03453 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:41.958807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-d7305d96-b42e-4788-a7a8-98f7c9348f89 req-8a70727e-6035-4eec-b9e6-8d099df03453 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:41.959237 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-d7305d96-b42e-4788-a7a8-98f7c9348f89 req-8a70727e-6035-4eec-b9e6-8d099df03453 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:41.971305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-d7305d96-b42e-4788-a7a8-98f7c9348f89 req-8a70727e-6035-4eec-b9e6-8d099df03453 service nova] Creating event network-changed:9c589d51-6feb-4258-869a-68069ebde8f1 for instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 on hv-cinder-85164 Aug 25 03:26:41.977174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-d7305d96-b42e-4788-a7a8-98f7c9348f89 req-8a70727e-6035-4eec-b9e6-8d099df03453 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034459 Aug 25 03:26:41.977721 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 344/696] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:45.753719 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:45.754231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:45.757732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:45.762561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:45.763045 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:45.763482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:45.764173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:45.764624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:45.765049 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:45.845811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lazy-loading 'services' on Instance uuid e2e2d76b-15ac-4d15-bd62-9835364dabc3 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:26:46.068191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1310e532-0e8a-4e72-a37e-711f27f75101 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments/b93a3d89-4929-4cad-9382-9860bf26047a" status: 202 len: 0 microversion: 2.1 time: 0.317608 Aug 25 03:26:46.068782 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 353/697] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:26:45 2022] DELETE /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments/b93a3d89-4929-4cad-9382-9860bf26047a => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:26:46.079120 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:46.081427 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:46.087462 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:46.087992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:46.088449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:46.089127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:46.089642 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:46.090061 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:46.119812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f479dc3b-fb4b-4590-991f-cb2213c9b7f1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Aug 25 03:26:46.120363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 345/698] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:26:46 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:47.133984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:47.136284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:47.142451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:47.142928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:47.143359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:47.144127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:47.144570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:47.145673 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:47.175274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-519b39f5-4371-4721-bd94-48c900a3bb02 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Aug 25 03:26:47.176036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 354/699] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:26:47 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:48.187809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:48.190079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:48.196452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.196920 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.197348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.198023 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.198497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.198914 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.228467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ff9dc6b8-bf8b-495c-9a74-fcc29b81e40d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044681 Aug 25 03:26:48.229017 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 346/700] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:26:48 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:26:48.260821 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:48.261328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:48.267940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.270947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.270947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.270947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.270947 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.271305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.295287 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3c92ece9-1153-4ea0-9aa7-4dcc7114aa70 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec/ips" status: 200 len: 150 microversion: 2.1 time: 0.090873 Aug 25 03:26:48.296023 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 355/701] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:26:48 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:26:48.307362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47bd704b-a8c5-41b2-b108-29e218fab13d"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:48.309912 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:48.314967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:48.315553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:48.316201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.316688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.317152 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.317860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.318329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.318755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.321843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.322341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.322771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.323449 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.323893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.324306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.349649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:26:48.398103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Invalid volume: volume 47bd704b-a8c5-41b2-b108-29e218fab13d is already attached to instances: 3e412db1-9619-4776-a113-7323c77edc58 Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: POST /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec/os-volume_attachments HTTP/1.1 Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 74 Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:26:48.399846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {"volumeAttachment": {"volumeId": "47bd704b-a8c5-41b2-b108-29e218fab13d"}} Aug 25 03:26:48.401363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Invalid volume: volume 47bd704b-a8c5-41b2-b108-29e218fab13d is already attached to instances: 3e412db1-9619-4776-a113-7323c77edc58 Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'server_id': '83d66607-d18c-4819-a699-018f461be7ec', 'body': {'volumeAttachment': {'volumeId': '47bd704b-a8c5-41b2-b108-29e218fab13d'}}} Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 47bd704b-a8c5-41b2-b108-29e218fab13d is already attached to instances: 3e412db1-9619-4776-a113-7323c77edc58 Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:48.402378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 47bd704b-a8c5-41b2-b108-29e218fab13d is already attached to instances: 3e412db1-9619-4776-a113-7323c77edc58 Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:48.403998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 47bd704b-a8c5-41b2-b108-29e218fab13d is already attached to instances: 3e412db1-9619-4776-a113-7323c77edc58 Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 400 to user: Invalid volume: volume 47bd704b-a8c5-41b2-b108-29e218fab13d is already attached to instances: 3e412db1-9619-4776-a113-7323c77edc58 {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7532a096-a157-45c4-a03e-d519ac15b7b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098037 Aug 25 03:26:48.405544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 347/702] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:26:48 2022] POST /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 03:26:48.409557 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:48.410046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:48.415696 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.416171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.416604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.417286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.417734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.418156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.443215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:26:48.634617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4bf175e3-8d6f-4f83-ac90-edc625d302e1 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 204 len: 0 microversion: 2.1 time: 0.323094 Aug 25 03:26:48.635367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 356/703] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:26:48 2022] DELETE /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:26:48.643764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:48.644481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:48.650952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.652093 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.652535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.653231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.653686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.654112 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.714156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5949357b-21be-4bf7-a4aa-8b0f5976ea52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 204 len: 0 microversion: 2.1 time: 0.307671 Aug 25 03:26:48.714675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 348/704] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:26:48 2022] DELETE /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:26:48.723200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:48.723896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:48.729839 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.730349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.730789 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.731483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:48.731936 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:48.732357 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:48.820542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:48.828793 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-43b66f4c-f335-469d-be11-f0349da29cb3 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1688 microversion: 2.1 time: 0.189162 Aug 25 03:26:48.839092 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 357/705] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:48 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:26:48.880084 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:48.887780 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b0038a0a-adae-461b-922e-7c28365a0783 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1682 microversion: 2.1 time: 0.168664 Aug 25 03:26:48.890372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 349/706] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:48 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:26:49.850068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:49.850711 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:49.857986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:49.857986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:49.858476 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:49.859236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:49.859678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:49.860179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:49.878466 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:49.909074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:49.909686 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:49.916692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:49.917209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:49.917647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:49.918373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:49.918830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:49.921384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:50.033275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:50.041578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9d3336a9-e007-44fe-857a-c93056873a04 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1688 microversion: 2.1 time: 0.196212 Aug 25 03:26:50.042154 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 358/707] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:49 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:50.076323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:50.083943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c47f3b6c-603e-4454-be74-b20e62765c12 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1682 microversion: 2.1 time: 0.178752 Aug 25 03:26:50.084533 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 350/708] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:49 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:26:51.063261 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:51.064121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:51.071455 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:51.071941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:51.072403 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:51.073102 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:51.073555 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:51.074008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:51.105006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:51.105640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:51.112016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:51.112489 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:51.112917 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:51.114138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:51.114639 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:51.115049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:51.255842 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:51.263542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b695b5e8-f58a-468e-b4e7-a6aaa5eeec5e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1688 microversion: 2.1 time: 0.204227 Aug 25 03:26:51.264099 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 359/709] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:51 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1688 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:51.281288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:51.289004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0aba2ee7-c166-47cd-8199-b976265a4e1c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1682 microversion: 2.1 time: 0.187840 Aug 25 03:26:51.289565 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 351/710] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:51 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:26:52.284642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:52.285185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:52.292029 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:52.292506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:52.292937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:52.293620 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:52.294071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:52.294535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:52.309958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:52.310604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:52.317718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:52.318211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:52.318648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:52.319332 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:52.319779 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:52.320210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:52.484036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:52.492599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1ce1fafc-a91a-4dc1-893c-6995c3f48b0b tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1688 microversion: 2.1 time: 0.211869 Aug 25 03:26:52.493275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 360/711] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:52 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:52.505865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:52.513654 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-259ed3b8-46ef-4975-a0df-099f0e5a043a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1682 microversion: 2.1 time: 0.207499 Aug 25 03:26:52.514378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 352/712] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:52 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:26:53.513740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:53.514407 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:53.520822 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:53.521303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:53.521733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:53.522453 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:53.522906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:53.523326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:53.540107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:53.540736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:53.546905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:53.547375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:53.547801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:53.548481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:53.548924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:53.549336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:53.722421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:53.726759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:53.730796 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-53fe3a63-e633-45bc-9ae1-8e2131e9902e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1688 microversion: 2.1 time: 0.220982 Aug 25 03:26:53.731383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 361/713] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:53 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:53.734296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a7f8a024-1982-450e-bf94-a14d6fbf29e0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1682 microversion: 2.1 time: 0.198072 Aug 25 03:26:53.734948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 353/714] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:53 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:26:54.757127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:54.758365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:54.758985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:54.760970 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:54.769160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:54.774867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:54.774867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:54.775215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:54.775215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:54.775215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:54.775671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:54.775819 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:54.775969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:54.776150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:54.776150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:54.776463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:55.084672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:55.087517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:55.096265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4690e1fd-9e56-45ec-bb85-922362f5b0ac tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1688 microversion: 2.1 time: 0.347628 Aug 25 03:26:55.097491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a6ab9011-e6c1-4261-92ed-4b29fd7eaf58 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1682 microversion: 2.1 time: 0.344974 Aug 25 03:26:55.111043 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 354/716] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:54 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1682 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:55.112607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 362/716] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:54 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1688 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:55.332248 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-c392d0ba-731b-4fa0-b85d-fe44cec6f0bb req-d313a8bb-1467-4a9e-9e32-f4fd86fc9739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d66607-d18c-4819-a699-018f461be7ec", "name": "network-vif-deleted", "tag": "981f3602-e4ac-40b3-a185-b66b8fbe7b1b"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:55.342756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-c392d0ba-731b-4fa0-b85d-fe44cec6f0bb req-d313a8bb-1467-4a9e-9e32-f4fd86fc9739 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:55.343591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-c392d0ba-731b-4fa0-b85d-fe44cec6f0bb req-d313a8bb-1467-4a9e-9e32-f4fd86fc9739 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:55.344276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-c392d0ba-731b-4fa0-b85d-fe44cec6f0bb req-d313a8bb-1467-4a9e-9e32-f4fd86fc9739 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:55.356400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-c392d0ba-731b-4fa0-b85d-fe44cec6f0bb req-d313a8bb-1467-4a9e-9e32-f4fd86fc9739 service nova] Creating event network-vif-deleted:981f3602-e4ac-40b3-a185-b66b8fbe7b1b for instance 83d66607-d18c-4819-a699-018f461be7ec on hv-cinder-85164 Aug 25 03:26:55.362408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-c392d0ba-731b-4fa0-b85d-fe44cec6f0bb req-d313a8bb-1467-4a9e-9e32-f4fd86fc9739 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033790 Aug 25 03:26:55.364374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 355/717] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:55.507297 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-02769a0d-4d3b-40d8-b060-82443a695b22 req-6dafe835-ad51-4449-9b34-cefbdd163f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e2d76b-15ac-4d15-bd62-9835364dabc3", "name": "network-vif-deleted", "tag": "c45badac-76ed-40f5-ace2-d566d6e55505"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:26:55.523778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-02769a0d-4d3b-40d8-b060-82443a695b22 req-6dafe835-ad51-4449-9b34-cefbdd163f5e service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:55.524255 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-02769a0d-4d3b-40d8-b060-82443a695b22 req-6dafe835-ad51-4449-9b34-cefbdd163f5e service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:55.524680 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-02769a0d-4d3b-40d8-b060-82443a695b22 req-6dafe835-ad51-4449-9b34-cefbdd163f5e service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:55.537327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-02769a0d-4d3b-40d8-b060-82443a695b22 req-6dafe835-ad51-4449-9b34-cefbdd163f5e service nova] Creating event network-vif-deleted:c45badac-76ed-40f5-ace2-d566d6e55505 for instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 on hv-cinder-85164 Aug 25 03:26:55.544257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-02769a0d-4d3b-40d8-b060-82443a695b22 req-6dafe835-ad51-4449-9b34-cefbdd163f5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041785 Aug 25 03:26:55.545501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 363/718] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:56.121656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:56.122196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:56.122681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:56.129220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:56.129432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:56.129723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:56.130427 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:56.131482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:56.132115 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:56.132542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:56.144379 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:56.144985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:56.146369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:56.147094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:56.147560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:56.147988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:56.188985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:56.189792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:56.191137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:56.194424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lazy-loading 'fault' on Instance uuid 83d66607-d18c-4819-a699-018f461be7ec {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:26:56.212817 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:56.213408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:56.214128 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:56.214601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lazy-loading 'fault' on Instance uuid e2e2d76b-15ac-4d15-bd62-9835364dabc3 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:26:56.217946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:26:56.287331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:56.288451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:26:56.296015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-90d70d03-2595-451f-8cfc-34973eb0f65e tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 200 len: 1335 microversion: 2.1 time: 0.178497 Aug 25 03:26:56.306311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ca65b567-c13c-421c-bf2d-3d8170b6ffff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 200 len: 1332 microversion: 2.1 time: 0.179317 Aug 25 03:26:56.306311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 364/719] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:56 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 1332 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:56.307224 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 356/720] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:56 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 1335 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:26:57.318072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:57.318708 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:57.319103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:57.319714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e2e2d76b-15ac-4d15-bd62-9835364dabc3] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:57.325359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:57.325870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:57.326336 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:57.326450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:57.326882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:57.327013 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:57.327319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:57.327475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:57.327896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:57.328009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:57.328437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:57.328857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:57.342418 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:26:57.342599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] HTTP exception thrown: Instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 could not be found. Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec HTTP/1.1 Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:26:57.344072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:26:57.345684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '83d66607-d18c-4819-a699-018f461be7ec'} Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:26:57.347104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:26:57.349288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Request method failure captured: Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 HTTP/1.1 Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuokvio5MAixDZYM2euCbL_fTjJk82CeD55b7xEUH87akmz6n46pEBabt24-P2Sd-52Y9x0Y-c2jIfTMrW6wstMY4aBYnbVx9GD_UJWoSemlxT_0P_efCgouKwRgI-lOkTvYmIQWkUrAwYwO2Yk9h4StfingqGT4FXZ_BEKqDvGKCNo Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:26:57.351130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d0928e519ec247b988a254d7918cbfed"}]}] Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: c7dc5019b26a4a8abf6436be3f1e56af Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 could not be found. Aug 25 03:26:57.352603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'e2e2d76b-15ac-4d15-bd62-9835364dabc3'} Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 could not be found. Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:26:57.353458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 could not be found. Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 could not be found. Aug 25 03:26:57.355178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:26:57.356434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:26:57.356555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Returning 404 to user: Instance e2e2d76b-15ac-4d15-bd62-9835364dabc3 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:26:57.356655 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cb660435-3e5c-474d-843a-636b75c0ec81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 404 len: 111 microversion: 2.1 time: 0.031358 Aug 25 03:26:57.356755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e2e61387-0797-47d1-aa84-233bb2ed2586 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3" status: 404 len: 111 microversion: 2.1 time: 0.031075 Aug 25 03:26:57.356755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 357/721] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:57 2022] GET /compute/v2.1/servers/e2e2d76b-15ac-4d15-bd62-9835364dabc3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:26:57.356917 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 365/722] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:26:57 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:26:57.356917 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-848be173-0657-4e4d-9b6e-de5c0f014cc4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '.version_select at 0x7fa33a5d99d0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:57.357085 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a6e951da-8862-4137-b1b3-1abfbf31dd39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '.version_select at 0x7fa33a763940>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:57.428877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a6e951da-8862-4137-b1b3-1abfbf31dd39 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441783100" status: 202 len: 0 microversion: 2.1 time: 0.077657 Aug 25 03:26:57.429467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 358/723] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Aug 25 03:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441783100 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:26:57.440496 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-848be173-0657-4e4d-9b6e-de5c0f014cc4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227137421" status: 202 len: 0 microversion: 2.1 time: 0.089282 Aug 25 03:26:57.441290 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 366/724] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Aug 25 03:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227137421 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:26:58.283595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:58.284199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:58.290900 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:58.291386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:58.291826 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:58.292511 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:58.292966 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:58.293386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:58.375108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lazy-loading 'services' on Instance uuid 3e412db1-9619-4776-a113-7323c77edc58 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:26:58.565532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-abcc438b-dea8-4584-813a-760fc75a873a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments/47bd704b-a8c5-41b2-b108-29e218fab13d" status: 202 len: 0 microversion: 2.1 time: 0.285692 Aug 25 03:26:58.566131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 359/725] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:26:58 2022] DELETE /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments/47bd704b-a8c5-41b2-b108-29e218fab13d => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:26:58.575979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:58.578583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:58.588169 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:58.588651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:58.589085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:58.589779 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:58.590265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:58.595760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:58.619886 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-94de77a3-c060-438e-9598-de237510f2b0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048527 Aug 25 03:26:58.620460 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 367/726] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:26:58 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:26:59.639324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:26:59.641546 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:26:59.650580 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:59.651067 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:59.651499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:59.652196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:26:59.652680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:26:59.653107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:26:59.683233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ca0b09ff-eabd-4343-8f30-60235b32b394 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054247 Aug 25 03:26:59.683708 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 360/727] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:26:59 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:00.675331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:00.675858 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:00.682759 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.683236 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.683669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:00.684350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.684798 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.685216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:00.696057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:00.698198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:00.704809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.705293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.705875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:00.706643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.707165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.707530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:00.711263 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:27:00.735767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b04b35e3-451b-478b-90e7-f91a0bf997a0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044301 Aug 25 03:27:00.736331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 361/728] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:27:00 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 03:27:00.797953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:00.798594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:00.805155 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.805630 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.806064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:00.806790 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.807240 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.807658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:00.833839 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:27:00.959973 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a08b03c4-c39f-4e01-8137-bcc1c295c287 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 204 len: 0 microversion: 2.1 time: 0.288088 Aug 25 03:27:00.960578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 368/729] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:00 2022] DELETE /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:27:00.968799 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:00.969499 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:00.975389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.975874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.976305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:00.976991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:00.977486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:00.977911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:01.056722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-55cc5c4c-cfed-4313-9f94-9b37e114cb42 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 204 len: 0 microversion: 2.1 time: 0.262243 Aug 25 03:27:01.057313 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 362/730] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:00 2022] DELETE /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:27:01.065945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:01.067802 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:01.073285 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:01.073767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:01.074196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:01.074950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:01.075400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:01.075821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:01.110734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:01.119196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6e836885-b6a8-4cd0-a36e-5df2d3fdf990 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1508 microversion: 2.1 time: 0.154383 Aug 25 03:27:01.120020 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 369/731] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:00 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:01.211846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:01.219830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bf8c4281-3496-4c29-bb28-af971fd80e48 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1682 microversion: 2.1 time: 0.158120 Aug 25 03:27:01.222175 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 363/732] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:01 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:02.140697 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:02.141302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:02.148547 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.149028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.149462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.150158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.150681 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.151112 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.241590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:02.242204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:02.249507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.250070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.251201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.251941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.252610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.253090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.284960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:02.293230 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7aa4bcdc-32fc-4564-ad44-b8a1726648d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1508 microversion: 2.1 time: 0.157078 Aug 25 03:27:02.293811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 370/733] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:02 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:02.387314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:02.395285 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d8b36412-b918-4a96-ad57-4fa536db376f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1682 microversion: 2.1 time: 0.158022 Aug 25 03:27:02.395798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 364/734] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:02 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:03.006050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-1020f3bb-b49b-4da0-acf1-235b1c7d6290 req-bcbd9e73-5a90-4766-b840-fca9a7360189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51885fa-4bf2-4ac7-83f2-f2602026abef", "name": "network-vif-deleted", "tag": "21f33b3d-4de9-4a8d-a91d-ba726d282ce6"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:03.015875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1020f3bb-b49b-4da0-acf1-235b1c7d6290 req-bcbd9e73-5a90-4766-b840-fca9a7360189 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.017503 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1020f3bb-b49b-4da0-acf1-235b1c7d6290 req-bcbd9e73-5a90-4766-b840-fca9a7360189 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.017503 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-1020f3bb-b49b-4da0-acf1-235b1c7d6290 req-bcbd9e73-5a90-4766-b840-fca9a7360189 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.033533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-1020f3bb-b49b-4da0-acf1-235b1c7d6290 req-bcbd9e73-5a90-4766-b840-fca9a7360189 service nova] Creating event network-vif-deleted:21f33b3d-4de9-4a8d-a91d-ba726d282ce6 for instance e51885fa-4bf2-4ac7-83f2-f2602026abef on hv-cinder-85164 Aug 25 03:27:03.039492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-1020f3bb-b49b-4da0-acf1-235b1c7d6290 req-bcbd9e73-5a90-4766-b840-fca9a7360189 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037921 Aug 25 03:27:03.040125 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 371/735] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:03.315165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:03.315787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:03.325821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.326681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.327475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.328499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.329215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.329796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.370372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.371125 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.371561 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.372012 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lazy-loading 'fault' on Instance uuid e51885fa-4bf2-4ac7-83f2-f2602026abef {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:27:03.418141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:03.418781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:03.427942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.428433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.428868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.429573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.430211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.430679 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.481830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:03.489759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e38def0e-2719-40c4-89b5-473bec9d96d7 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 200 len: 1311 microversion: 2.1 time: 0.178741 Aug 25 03:27:03.490382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 365/736] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:03 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:03.504237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:03.512999 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e56b350c-eebe-45d5-9049-d5ef1d84dc01 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1615 microversion: 2.1 time: 0.100136 Aug 25 03:27:03.513677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 372/737] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:03 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1615 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:03.731018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-1c1ca562-2313-47b0-ac96-4f897c7fc1b0 req-68c148cb-101a-4d2c-a214-93c9699a7f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e412db1-9619-4776-a113-7323c77edc58", "name": "network-vif-deleted", "tag": "24ce5711-73e2-4aca-8005-7327565d8aa0"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:03.741898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-1c1ca562-2313-47b0-ac96-4f897c7fc1b0 req-68c148cb-101a-4d2c-a214-93c9699a7f2f service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.742871 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-1c1ca562-2313-47b0-ac96-4f897c7fc1b0 req-68c148cb-101a-4d2c-a214-93c9699a7f2f service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.743013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-1c1ca562-2313-47b0-ac96-4f897c7fc1b0 req-68c148cb-101a-4d2c-a214-93c9699a7f2f service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.755876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-1c1ca562-2313-47b0-ac96-4f897c7fc1b0 req-68c148cb-101a-4d2c-a214-93c9699a7f2f service nova] Creating event network-vif-deleted:24ce5711-73e2-4aca-8005-7327565d8aa0 for instance 3e412db1-9619-4776-a113-7323c77edc58 on hv-cinder-85164 Aug 25 03:27:03.761275 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-1c1ca562-2313-47b0-ac96-4f897c7fc1b0 req-68c148cb-101a-4d2c-a214-93c9699a7f2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033855 Aug 25 03:27:03.761883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 366/738] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:04.513048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:04.513752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: e51885fa-4bf2-4ac7-83f2-f2602026abef] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:04.520627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.521204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.522373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.529308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.529308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.529308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.536701 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:04.538663 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:04.539552 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] HTTP exception thrown: Instance e51885fa-4bf2-4ac7-83f2-f2602026abef could not be found. Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Request method failure captured: Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef HTTP/1.1 Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuokvio5MAixDZYM2euCbL_fTjJk82CeD55b7xEUH87akmz6n46pEBabt24-P2Sd-52Y9x0Y-c2jIfTMrW6wstMY4aBYnbVx9GD_UJWoSemlxT_0P_efCgouKwRgI-lOkTvYmIQWkUrAwYwO2Yk9h4StfingqGT4FXZ_BEKqDvGKCNo Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:27:04.541341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d0928e519ec247b988a254d7918cbfed"}]}] Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: c7dc5019b26a4a8abf6436be3f1e56af Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance e51885fa-4bf2-4ac7-83f2-f2602026abef could not be found. Aug 25 03:27:04.542952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'e51885fa-4bf2-4ac7-83f2-f2602026abef'} Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51885fa-4bf2-4ac7-83f2-f2602026abef could not be found. Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:04.543735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51885fa-4bf2-4ac7-83f2-f2602026abef could not be found. Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51885fa-4bf2-4ac7-83f2-f2602026abef could not be found. Aug 25 03:27:04.544964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:04.548634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Returning 404 to user: Instance e51885fa-4bf2-4ac7-83f2-f2602026abef could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:04.548634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7a5a5cec-8ac3-41a2-9978-de7d2bc2be59 tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef" status: 404 len: 111 microversion: 2.1 time: 0.034169 Aug 25 03:27:04.548634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 373/739] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:04 2022] GET /compute/v2.1/servers/e51885fa-4bf2-4ac7-83f2-f2602026abef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:04.549334 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.549817 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.550337 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.555691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.555691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.555691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.555991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:04.555991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:04.560533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.561027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.561465 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.562202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.562650 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.563319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.589119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.590460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.590969 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.591592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lazy-loading 'fault' on Instance uuid 3e412db1-9619-4776-a113-7323c77edc58 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:27:04.593299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:27:04.643208 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:04.651919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9cb947a8-834b-4faf-a7ce-473b2d1367f2 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 200 len: 1332 microversion: 2.1 time: 0.120081 Aug 25 03:27:04.652496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 367/740] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:04 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:04.960229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b0d5d15e-9d10-403c-85b7-8b197922d28a tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 204 len: 0 microversion: 2.1 time: 0.410341 Aug 25 03:27:04.961027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 374/741] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:04 2022] DELETE /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:27:04.970745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:04.971356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:04.977232 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.977710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.978142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.978867 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.979351 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.979777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:05.108532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:05.116135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3a62f47f-78b9-43ea-aec4-24f0f9ae636d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.149289 Aug 25 03:27:05.116698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 368/742] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:04 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:05.674054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:05.674802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:05.681844 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:05.682456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:05.682794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:05.683482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:05.683937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:05.684361 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:05.688741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:05.697741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 HTTP/1.1 Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:27:05.699343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:27:05.700969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '3e412db1-9619-4776-a113-7323c77edc58'} Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:05.701896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:27:05.703373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:05.704645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:05.704645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-45c4e7df-8839-41c7-9f49-4c64827f7d22 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 404 len: 111 microversion: 2.1 time: 0.030892 Aug 25 03:27:05.704645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 375/743] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:05 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:05.709650 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0e2d1e4f-d60b-4e79-9d97-b6590ceb5a05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '.version_select at 0x7fa33a637430>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:05.788851 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0e2d1e4f-d60b-4e79-9d97-b6590ceb5a05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698721012" status: 202 len: 0 microversion: 2.1 time: 0.082975 Aug 25 03:27:05.789428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 369/744] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Aug 25 03:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698721012 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:27:06.138171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:06.139254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:06.147411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.153120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.153120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.153120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.153120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.153567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.348407 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:06.356497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d06bc097-4cf1-4714-96c6-01b6ac02dccd tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1522 microversion: 2.1 time: 0.223312 Aug 25 03:27:06.357153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 376/745] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:06 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:06.504146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-14ab72ef-48d7-418b-aff5-073706353651 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: .version_select at 0x7fa33a735310>, body: {"keypair": {"name": "tempest-keypair-783583290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKPfJgDtI0lcOtIx/XUKtjAELN1zJVLQleMuBkQ9wKS974xPFXDzsJ6yezaJPcr0Efb8/pGpf+2CnWv92iavQVnY/Q7Brwjypt+oHC0MewHWXL5b+UaiJsQqfyUmstHJg=="}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:06.528468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-14ab72ef-48d7-418b-aff5-073706353651 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:27:06.533100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-14ab72ef-48d7-418b-aff5-073706353651 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:27:06.555216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-38ca5524-e485-4d25-adfe-d33fd0a49a08 req-f14b22b1-5829-430a-b2c7-828cb06ea6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccfd9dce-16ff-4644-a35d-aadaad1fb6e0", "name": "network-vif-deleted", "tag": "6617e5b0-8d38-402d-9b29-b384949c1c60"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:06.564643 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-38ca5524-e485-4d25-adfe-d33fd0a49a08 req-f14b22b1-5829-430a-b2c7-828cb06ea6a8 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.565116 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-38ca5524-e485-4d25-adfe-d33fd0a49a08 req-f14b22b1-5829-430a-b2c7-828cb06ea6a8 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.565541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-38ca5524-e485-4d25-adfe-d33fd0a49a08 req-f14b22b1-5829-430a-b2c7-828cb06ea6a8 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.577328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-38ca5524-e485-4d25-adfe-d33fd0a49a08 req-f14b22b1-5829-430a-b2c7-828cb06ea6a8 service nova] Creating event network-vif-deleted:6617e5b0-8d38-402d-9b29-b384949c1c60 for instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 on hv-cinder-85164 Aug 25 03:27:06.582541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-38ca5524-e485-4d25-adfe-d33fd0a49a08 req-f14b22b1-5829-430a-b2c7-828cb06ea6a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031011 Aug 25 03:27:06.583688 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 377/746] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:27:06.612838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-14ab72ef-48d7-418b-aff5-073706353651 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113321 Aug 25 03:27:06.619415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 370/747] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:27:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:06.635458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:06.644860 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:06.645399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.645917 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.646985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.647764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.648151 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.648563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.678203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-da823939-158e-43fc-b134-bb415927f830 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047228 Aug 25 03:27:06.678908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 378/748] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:27:06 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:27:06.742404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:06.742918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:06.749979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.750546 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.751053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.751745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.752192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.752715 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.782176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:27:07.107579 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4ed8fd9d-3cb5-46a3-8ee3-ae5c8f704404 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 204 len: 0 microversion: 2.1 time: 0.369316 Aug 25 03:27:07.108096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 371/749] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:06 2022] DELETE /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:27:07.116877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:07.117482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:07.123993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:07.124489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:07.124921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:07.125619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:07.126069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:07.126520 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:07.264306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:07.277558 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a82ee03a-aa9a-4b66-bba5-037db217f75b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1674 microversion: 2.1 time: 0.164837 Aug 25 03:27:07.280592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 379/750] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:07 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:07.377467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:07.378156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:07.384153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:07.389693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:07.389693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:07.389693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:07.389693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:07.390087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:07.416970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:07.417440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:07.417870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:07.418337 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lazy-loading 'fault' on Instance uuid ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:27:07.421045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:07.461545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dc5019b26a4a8abf6436be3f1e56af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0928e519ec247b988a254d7918cbfed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:07.469045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bb81696f-7d97-4d46-b928-622f9610446f tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 200 len: 1311 microversion: 2.1 time: 0.095827 Aug 25 03:27:07.469896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 372/751] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:07 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:08.300150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:08.300742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:08.307780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:08.308258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:08.308887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:08.309581 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:08.310108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:08.310736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:08.442151 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:08.450523 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ab99b663-f27b-455b-b495-c0532d041558 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1674 microversion: 2.1 time: 0.154339 Aug 25 03:27:08.451323 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 380/752] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:08 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:08.495672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:08.496273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] [instance: ccfd9dce-16ff-4644-a35d-aadaad1fb6e0] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:08.502990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:08.503461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:08.503887 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:08.504576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:08.505052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:08.505475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:08.519870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] HTTP exception thrown: Instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 could not be found. Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Request method failure captured: Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 HTTP/1.1 Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuokvio5MAixDZYM2euCbL_fTjJk82CeD55b7xEUH87akmz6n46pEBabt24-P2Sd-52Y9x0Y-c2jIfTMrW6wstMY4aBYnbVx9GD_UJWoSemlxT_0P_efCgouKwRgI-lOkTvYmIQWkUrAwYwO2Yk9h4StfingqGT4FXZ_BEKqDvGKCNo Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:27:08.521595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d0928e519ec247b988a254d7918cbfed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d0928e519ec247b988a254d7918cbfed"}]}] Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: d0928e519ec247b988a254d7918cbfed Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-433872623 Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: c7dc5019b26a4a8abf6436be3f1e56af Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-433872623-project Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 could not be found. Aug 25 03:27:08.523251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'ccfd9dce-16ff-4644-a35d-aadaad1fb6e0'} Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 could not be found. Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:08.524109 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 could not be found. Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 could not be found. Aug 25 03:27:08.525532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:08.526678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] Returning 404 to user: Instance ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:08.526678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a1602b2e-1558-4f5a-8b01-41316657098d tempest-ServerRescueNegativeTestJSON-433872623 tempest-ServerRescueNegativeTestJSON-433872623-project] 10.222.0.58 "GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0" status: 404 len: 111 microversion: 2.1 time: 0.031680 Aug 25 03:27:08.526678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 373/753] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:08 2022] GET /compute/v2.1/servers/ccfd9dce-16ff-4644-a35d-aadaad1fb6e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:08.842010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1794646809", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "256737dd-9a94-4238-9f74-9979facae111"}], "security_groups": [{"name": "tempest-securitygroup--650719526"}], "key_name": "tempest-keypair-783583290", "user_data": "}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:09.075722 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] validate_networks() for [('256737dd-9a94-4238-9f74-9979facae111', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:27:09.472868 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:09.473601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:09.475420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:09.480342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:09.480819 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:09.481252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:09.481951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:09.482432 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:09.483269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:10.150516 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:10.158329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3ed0be6f-2e17-4c4e-b0a3-0ec8e33c720d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1674 microversion: 2.1 time: 0.689682 Aug 25 03:27:10.158905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 374/754] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:09 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1674 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:10.340938 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:27:10.341439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:27:10.341852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:27:10.342260 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:27:10.342700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:27:10.352134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:10.352615 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:10.353049 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:10.353779 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:10.354235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:10.354696 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:10.372137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:27:10.376106 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:27:10.387511 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:27:10.389789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:27:10.515139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-91c057d6-1665-4502-a9cd-27a63a50e5cf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.677450 Aug 25 03:27:10.515983 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 381/755] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:27:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:27:10.527634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-73dd1b0c-8fd9-4fc3-a0be-356fa7eb0910 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:10.531019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-73dd1b0c-8fd9-4fc3-a0be-356fa7eb0910 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:10.628193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-73dd1b0c-8fd9-4fc3-a0be-356fa7eb0910 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:10.638876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-73dd1b0c-8fd9-4fc3-a0be-356fa7eb0910 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1241 microversion: 2.1 time: 0.115226 Aug 25 03:27:10.641287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 375/756] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:10 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:11.012603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-0ed719fe-c323-4137-98e5-be9d150e5216 req-1e77e2df-aabe-40bd-bcca-4cad429738cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89", "name": "network-vif-deleted", "tag": "2633e92d-506e-4aa5-964a-5eee157a0a48"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:11.026136 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0ed719fe-c323-4137-98e5-be9d150e5216 req-1e77e2df-aabe-40bd-bcca-4cad429738cb service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:11.026999 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0ed719fe-c323-4137-98e5-be9d150e5216 req-1e77e2df-aabe-40bd-bcca-4cad429738cb service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:11.027849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-0ed719fe-c323-4137-98e5-be9d150e5216 req-1e77e2df-aabe-40bd-bcca-4cad429738cb service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:11.074609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-0ed719fe-c323-4137-98e5-be9d150e5216 req-1e77e2df-aabe-40bd-bcca-4cad429738cb service nova] Creating event network-vif-deleted:2633e92d-506e-4aa5-964a-5eee157a0a48 for instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 on hv-cinder-85164 Aug 25 03:27:11.086892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-0ed719fe-c323-4137-98e5-be9d150e5216 req-1e77e2df-aabe-40bd-bcca-4cad429738cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079640 Aug 25 03:27:11.090242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 382/757] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:11.180441 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:11.181205 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:11.194706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:11.198853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:11.199604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:11.200534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:11.203130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:11.203752 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:11.343923 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:11.353013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-33454dd8-23b3-4b09-8f47-ed93c5e95a70 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 200 len: 1323 microversion: 2.1 time: 0.177139 Aug 25 03:27:11.356960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 376/758] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:11 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:11.660791 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:11.661499 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:11.687285 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:11.688397 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:11.689004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:11.689911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:11.693489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:11.694124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:11.834430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:11.843921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4d1e73ef-1a2e-4b50-b4e1-ff0f799c6a25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1245 microversion: 2.1 time: 0.187237 Aug 25 03:27:11.844630 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 383/759] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:11 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1245 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:12.375545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:12.384045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:12.391438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:12.396983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:12.396983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:12.396983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:12.396983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:12.397359 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:12.409324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] HTTP exception thrown: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Request method failure captured: Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 HTTP/1.1 Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuomQY7oXJwhOW09tgSssDaHsuPkcTcuHD_n86IShE52SCIYJ9qj1P10okFi_R1tbeBKWThrXBn0ZfJaJ522qlZ2F19GF8CbPyYmBDxOgpbT6XURodNEw1ofa0rumFMRr-l9ncfl6MJd4Ekr8xQjozhM_KIpzPgPx8_wKBRZ21ddJN0 Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:27:12.410869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6240beed94fc38a7f1b85c7fad39c"}]}] Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 83e90afadb164c82bc93c47099c14460 Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:27:12.412384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89'} Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:12.413157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:27:12.414390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:12.415457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Returning 404 to user: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:12.415457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-00ee8e67-e536-4f91-b29b-f608c798b514 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 404 len: 111 microversion: 2.1 time: 0.041201 Aug 25 03:27:12.415457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 377/760] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:12 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:12.421498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1428970b-ed5a-4dc7-875f-40e09fd1ff12 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '.version_select at 0x7fa33a5d9670>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:12.428729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:12.492641 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1428970b-ed5a-4dc7-875f-40e09fd1ff12 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010202725" status: 202 len: 0 microversion: 2.1 time: 0.074958 Aug 25 03:27:12.493544 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 384/761] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Aug 25 03:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010202725 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:27:12.866150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:12.870455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:12.873147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:12.873628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:12.874058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:12.874778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:12.875229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:12.875648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:13.248828 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:13.257672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2b784421-cd5e-4140-9de7-c9190e4a6bf4 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1301 microversion: 2.1 time: 0.395956 Aug 25 03:27:13.258616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 378/762] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:12 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1301 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:13.317537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7664c5ee-7d4a-4e64-8663-956a577e74f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'create', calling method: .version_select at 0x7fa33dfb1940>, body: {"keypair": {"name": "tempest-keypair-1710597728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWiEXQxytoeFzd4k2Wgzx9sI5ZCWQ9Z0JZMw/moV4tVM43rIPGJ1WeTHUQzZICH9pnc4NQC41VFcolO1MiTaacLXuS/56TT3eOXw+NCq5akZkKrQGXMqH4G7We5Y2zowA=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:13.346110 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-7664c5ee-7d4a-4e64-8663-956a577e74f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:27:13.351015 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-7664c5ee-7d4a-4e64-8663-956a577e74f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for user 83e90afadb164c82bc93c47099c14460 and project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:27:13.462115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7664c5ee-7d4a-4e64-8663-956a577e74f3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149448 Aug 25 03:27:13.463275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 385/763] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:27:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:14.280692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:14.281323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:14.288237 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:14.288764 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:14.289211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:14.290584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:14.291048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:14.291647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:14.746912 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:14.760335 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1b56fe62-fafa-457b-9555-1a5d53b21aff tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.483907 Aug 25 03:27:14.760916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 379/764] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:14 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:15.604396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-ad5e46ec-7ff7-41b5-894a-111f5fd6ee7f req-6b68738a-87b4-4e0e-9390-606176ebd068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e63fffa-925d-4288-b5b9-1ce22da25b57", "tag": "6ac885d7-37db-4141-9d71-a376b3b82292"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:15.614916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ad5e46ec-7ff7-41b5-894a-111f5fd6ee7f req-6b68738a-87b4-4e0e-9390-606176ebd068 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.615387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ad5e46ec-7ff7-41b5-894a-111f5fd6ee7f req-6b68738a-87b4-4e0e-9390-606176ebd068 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.615809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-ad5e46ec-7ff7-41b5-894a-111f5fd6ee7f req-6b68738a-87b4-4e0e-9390-606176ebd068 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.627925 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-ad5e46ec-7ff7-41b5-894a-111f5fd6ee7f req-6b68738a-87b4-4e0e-9390-606176ebd068 service nova] Creating event network-changed:6ac885d7-37db-4141-9d71-a376b3b82292 for instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 on hv-cinder-85164 Aug 25 03:27:15.644636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-ad5e46ec-7ff7-41b5-894a-111f5fd6ee7f req-6b68738a-87b4-4e0e-9390-606176ebd068 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048020 Aug 25 03:27:15.645958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 386/765] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:15.781265 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:15.781876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:15.788682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.789301 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.789579 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.790361 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.791628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.792056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:16.029210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:16.040104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c5f5eb39-2b43-46c1-9ea2-f154bd15556c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.262649 Aug 25 03:27:16.051097 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 380/766] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:15 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:16.090126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1368193899", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d61a031-2546-4f6b-af01-1710648e9256"}], "security_groups": [{"name": "tempest-securitygroup--181326726"}], "key_name": "tempest-keypair-1710597728", "user_data": "}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:16.240657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] validate_networks() for [('5d61a031-2546-4f6b-af01-1710648e9256', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:27:16.811177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:27:16.811813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:27:16.812220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:27:16.812691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:27:16.813421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:27:16.822857 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:16.823411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:16.823849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:16.824574 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:16.825029 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:16.825450 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:16.842927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:27:16.846849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Getting quotas for user 83e90afadb164c82bc93c47099c14460 and project d8e6240beed94fc38a7f1b85c7fad39c. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:27:16.857662 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:27:16.860045 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:27:17.012813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5840aaec-67ef-40f2-85db-ce2168502fbe tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.927652 Aug 25 03:27:17.013404 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 387/767] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:27:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:27:17.024894 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a8b0126a-1ccb-4416-9096-05e1bd44d2fb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:17.025608 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a8b0126a-1ccb-4416-9096-05e1bd44d2fb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:17.062466 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:17.064864 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:17.072119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:17.072609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:17.073041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:17.073748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:17.074529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:17.075311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:17.103611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a8b0126a-1ccb-4416-9096-05e1bd44d2fb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:17.113650 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a8b0126a-1ccb-4416-9096-05e1bd44d2fb tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1238 microversion: 2.1 time: 0.092693 Aug 25 03:27:17.114952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 381/768] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:17 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:17.245196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:17.253212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5755da17-653f-48b2-853b-715781dd45b9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.194576 Aug 25 03:27:17.253847 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 388/769] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:17 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:18.133569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:18.134102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:18.141168 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:18.141645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:18.142065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:18.142788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:18.143234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:18.143643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:18.205443 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:18.214269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7a7272ba-f79a-40eb-a952-79e4736f2e9f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1242 microversion: 2.1 time: 0.084507 Aug 25 03:27:18.219848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 382/770] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:18 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:18.275433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:18.276187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:18.282532 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:18.283091 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:18.283594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:18.284353 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:18.284986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:18.285408 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:18.416855 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:18.424700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ba889b41-047d-48af-8f93-addb142add55 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.153907 Aug 25 03:27:18.425283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 389/771] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:18 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:19.235785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:19.236488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:19.243014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:19.243494 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:19.244122 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:19.244829 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:19.245284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:19.245707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:19.312989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:19.322498 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-989a547e-6d70-4650-9b34-9b2ca0d35fd1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1242 microversion: 2.1 time: 0.089845 Aug 25 03:27:19.335892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 383/772] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:19 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:19.445975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:19.448201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:19.459452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:19.460409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:19.461139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:19.462064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:19.462816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:19.463453 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:19.606541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:19.615527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-43ad6525-08f7-4877-842d-58ed87bf7a3f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.173726 Aug 25 03:27:19.616112 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 390/773] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:19 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:20.345336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:20.346081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:20.353600 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:20.354969 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:20.355497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:20.356665 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:20.357366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:20.357892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:20.640450 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:20.641124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:20.651539 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:20.652026 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:20.652465 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:20.655342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:20.655342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:20.655342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:20.712664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:20.721198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b7b1d6e9-e450-48a6-bad0-9536e23e737e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1290 microversion: 2.1 time: 0.379666 Aug 25 03:27:20.755101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 384/774] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:20 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1290 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:20.969088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:20.978186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-60ecbb5a-a7ce-478d-a5c1-50843c169c79 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.344124 Aug 25 03:27:20.978823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 391/775] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:20 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:21.743773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:21.744655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:21.751829 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:21.752671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:21.753355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:21.754484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:21.755342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:21.756343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:21.858740 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:21.875050 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7a56ff07-73dd-49e7-956b-45ad6bb37264 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1296 microversion: 2.1 time: 0.135888 Aug 25 03:27:21.888553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 385/776] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:21 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1296 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:21.999810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:22.000422 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:22.009441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:22.010142 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:22.010776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:22.012174 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:22.012804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:22.015400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:22.350585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:22.359185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-979c3425-4457-4c33-8b3e-e4b0dd8ab499 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.363622 Aug 25 03:27:22.360183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 392/777] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:21 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:22.896281 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:22.896885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:22.904437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:22.905007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:22.905434 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:22.906124 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:22.906608 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:22.907027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:23.086134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:23.096475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8afb1ea8-6938-43ec-a323-9e000071c89b tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.204219 Aug 25 03:27:23.097204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 386/778] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:22 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:23.380462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:23.381224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:23.387981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:23.388576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:23.389152 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:23.389946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:23.390522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:23.391005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:23.687989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:23.709958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0065ab66-4288-4ee4-bd0e-00987cf866c9 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.332482 Aug 25 03:27:23.711255 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 393/779] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:23 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:23.945198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-d6a14513-b284-4fb9-99cb-0a7ac73a5a41 req-1926c435-5e77-4b9f-9230-39c5b80d9a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e63fffa-925d-4288-b5b9-1ce22da25b57", "name": "network-vif-plugged", "status": "completed", "tag": "6ac885d7-37db-4141-9d71-a376b3b82292"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:23.956445 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-d6a14513-b284-4fb9-99cb-0a7ac73a5a41 req-1926c435-5e77-4b9f-9230-39c5b80d9a0a service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:23.956935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-d6a14513-b284-4fb9-99cb-0a7ac73a5a41 req-1926c435-5e77-4b9f-9230-39c5b80d9a0a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:23.957363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-d6a14513-b284-4fb9-99cb-0a7ac73a5a41 req-1926c435-5e77-4b9f-9230-39c5b80d9a0a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:23.969623 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-d6a14513-b284-4fb9-99cb-0a7ac73a5a41 req-1926c435-5e77-4b9f-9230-39c5b80d9a0a service nova] Creating event network-vif-plugged:6ac885d7-37db-4141-9d71-a376b3b82292 for instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 on hv-cinder-85164 Aug 25 03:27:23.975559 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-d6a14513-b284-4fb9-99cb-0a7ac73a5a41 req-1926c435-5e77-4b9f-9230-39c5b80d9a0a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034716 Aug 25 03:27:23.976355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 387/780] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:27:24.036556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-aaea230b-019f-4958-92d1-94a445ab644f req-4c25fec6-2590-414a-9ab0-e53e9049cc08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b8ac9b-add0-42b0-a55e-842e74995095", "tag": "9c839108-8a6d-4e0d-82a1-3d11e580aa98"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:24.056509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-aaea230b-019f-4958-92d1-94a445ab644f req-4c25fec6-2590-414a-9ab0-e53e9049cc08 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:24.057279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-aaea230b-019f-4958-92d1-94a445ab644f req-4c25fec6-2590-414a-9ab0-e53e9049cc08 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:24.057916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-aaea230b-019f-4958-92d1-94a445ab644f req-4c25fec6-2590-414a-9ab0-e53e9049cc08 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:24.082232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-aaea230b-019f-4958-92d1-94a445ab644f req-4c25fec6-2590-414a-9ab0-e53e9049cc08 service nova] Creating event network-changed:9c839108-8a6d-4e0d-82a1-3d11e580aa98 for instance b6b8ac9b-add0-42b0-a55e-842e74995095 on hv-cinder-85164 Aug 25 03:27:24.093296 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-aaea230b-019f-4958-92d1-94a445ab644f req-4c25fec6-2590-414a-9ab0-e53e9049cc08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060227 Aug 25 03:27:24.094322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 394/781] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:24.120629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:24.121495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:24.157849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:24.158566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:24.159299 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:24.162572 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:24.165767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:24.166414 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:24.484071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:24.495767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a2f142ec-36fb-4d97-8849-7c1417b5015f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.379787 Aug 25 03:27:24.496667 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 388/782] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:24 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:24.498658 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9f540f14-0587-42b7-a149-50af5049c7c4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'create', calling method: .version_select at 0x7fa33a61a670>, body: {"keypair": {"name": "tempest-keypair-1308210535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLolcfKFJlLEZ966AFvIucfCkpEYOimczdEadJLhcXFTrpRXSToXsllGBfwebPy/i3rQyJG9Sx3+AN0ZXLI1BWQBvNS2vihgnYdoKOQTL92qRhJZdCps95i3MRbvuzn3YA=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:24.531246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9f540f14-0587-42b7-a149-50af5049c7c4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for project 3e22a25921ea45eba0f29a87edaba447. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:27:24.534446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-9f540f14-0587-42b7-a149-50af5049c7c4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for user 08a52103c0f4467c8366bd88e8b655e9 and project 3e22a25921ea45eba0f29a87edaba447. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:27:24.594302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9f540f14-0587-42b7-a149-50af5049c7c4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.306766 Aug 25 03:27:24.594954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 395/783] 10.222.0.58 () {62 vars in 1200 bytes} [Thu Aug 25 03:27:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 310 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 03:27:24.731852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:24.732462 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:24.738783 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:24.739480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:24.739950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:24.740655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:24.741105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:24.741554 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:24.877025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:24.886204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f8c9dd0f-c77c-4f60-afe2-3b6a20f079e5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.157857 Aug 25 03:27:24.887410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 389/784] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:24 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:25.519700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:25.521021 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:25.542472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:25.542978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:25.545130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:25.558576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:25.563797 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:25.564306 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:25.771227 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:25.782156 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a180803a-9663-4bdd-8360-581f3527ecf0 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.266735 Aug 25 03:27:25.795209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 396/785] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:25 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:25.908601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:25.909126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:25.916543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:25.918485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:25.918485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:25.919106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:25.919725 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:25.920363 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:26.156890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:26.169778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cad3c8a5-7567-4e53-af14-f7395e986d25 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1366 microversion: 2.1 time: 0.265580 Aug 25 03:27:26.171256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 390/786] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:25 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:26.802446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:26.803048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:26.810115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:26.810619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:26.811047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:26.811732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:26.812210 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:26.812883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:26.834786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:26.962639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:26.970733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0e1e9d30-19d5-4f07-a37e-e8aff3777b2d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.171975 Aug 25 03:27:26.971322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 397/787] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:26 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:27.016768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1081915959", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3297349b-20d8-4bb0-a13e-dac189a991a3"}], "security_groups": [{"name": "tempest-securitygroup--1456291766"}], "key_name": "tempest-keypair-1308210535", "user_data": "}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:27.108385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=8 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:27.123878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] validate_networks() for [('3297349b-20d8-4bb0-a13e-dac189a991a3', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:27:27.192664 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:27.193966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:27.200390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:27.200867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:27.201573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:27.202881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:27.203679 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:27.204248 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:27.395025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:27.403151 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-eb8c9927-4206-4981-8465-bd6b8ba9cee3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1557 microversion: 2.1 time: 0.214534 Aug 25 03:27:27.403724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 398/788] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:27 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:27.423542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:27.424049 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:27.430390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:27.430869 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:27.431303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:27.431987 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:27.432435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:27.432853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:27.449846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:27.530017 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b68ff0f-2bae-4adc-878e-4d154b08fc5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110103 Aug 25 03:27:27.530839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 399/789] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:27:27 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:27:27.743576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:27:27.744231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:27:27.744867 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:27:27.745431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:27:27.746116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:27:27.759703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:27.760435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:27.761032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:27.761926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:27.762598 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:27.763029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:27.779994 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for project 3e22a25921ea45eba0f29a87edaba447. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:27:27.783921 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for user 08a52103c0f4467c8366bd88e8b655e9 and project 3e22a25921ea45eba0f29a87edaba447. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:27:27.795429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:27:27.797775 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:27:27.933005 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8bbdf1a0-6a3a-4ad7-9b48-f24d9f85c993 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.920368 Aug 25 03:27:27.933831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 391/790] 10.222.0.58 () {62 vars in 1188 bytes} [Thu Aug 25 03:27:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 03:27:27.946044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-564ff5dc-04f5-48f0-a859-f2a7ae030082 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:27.947356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-564ff5dc-04f5-48f0-a859-f2a7ae030082 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:27.992508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:27.993454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:27.999763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:28.000247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:28.000682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:28.001541 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:28.001983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:28.002465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:28.015606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-564ff5dc-04f5-48f0-a859-f2a7ae030082 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:28.030736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-564ff5dc-04f5-48f0-a859-f2a7ae030082 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:28.039333 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-564ff5dc-04f5-48f0-a859-f2a7ae030082 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:28.045946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-564ff5dc-04f5-48f0-a859-f2a7ae030082 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1282 microversion: 2.20 time: 0.100524 Aug 25 03:27:28.046601 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 400/791] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:27 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:28.191776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:28.199656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5525be8a-1bae-459a-b510-09a50d26919d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.211979 Aug 25 03:27:28.200253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 392/792] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:27 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:28.909726 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-d454ac2e-03c2-4746-84aa-951bfdd4485a req-cc5ee790-cb37-4cf7-8ac0-c1ec2c7d0707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e63fffa-925d-4288-b5b9-1ce22da25b57", "tag": "6ac885d7-37db-4141-9d71-a376b3b82292"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:28.920652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d454ac2e-03c2-4746-84aa-951bfdd4485a req-cc5ee790-cb37-4cf7-8ac0-c1ec2c7d0707 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:28.921143 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d454ac2e-03c2-4746-84aa-951bfdd4485a req-cc5ee790-cb37-4cf7-8ac0-c1ec2c7d0707 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:28.921559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d454ac2e-03c2-4746-84aa-951bfdd4485a req-cc5ee790-cb37-4cf7-8ac0-c1ec2c7d0707 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:28.932096 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-d454ac2e-03c2-4746-84aa-951bfdd4485a req-cc5ee790-cb37-4cf7-8ac0-c1ec2c7d0707 service nova] Creating event network-changed:6ac885d7-37db-4141-9d71-a376b3b82292 for instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 on hv-cinder-85164 Aug 25 03:27:28.936954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-d454ac2e-03c2-4746-84aa-951bfdd4485a req-cc5ee790-cb37-4cf7-8ac0-c1ec2c7d0707 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031103 Aug 25 03:27:28.937880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 401/793] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:29.070426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:29.071185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:29.077773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:29.078513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:29.079156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:29.079841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:29.080453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:29.080992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:29.172046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:29.176090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=100 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:29.181910 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:29.183510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:29.184870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-af8c9eff-7a75-4941-955e-ba838c47aee8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1286 microversion: 2.20 time: 0.119186 Aug 25 03:27:29.185470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 393/794] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:29 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:29.221056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:29.221764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:29.228654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:29.229359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:29.229960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:29.230896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:29.231515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:29.232101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:29.376659 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:29.385996 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-72cac20a-a7e1-40eb-b7a7-c3c98fd8941d tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.169568 Aug 25 03:27:29.386614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 402/795] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:29 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:30.210311 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:30.211182 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:30.218496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:30.219020 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:30.219456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:30.220152 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:30.220599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:30.221015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:30.287290 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:30.294119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:30.295664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:30.296747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-55267d1b-63a3-420d-9ae6-d40ab5495e1c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1334 microversion: 2.20 time: 0.091445 Aug 25 03:27:30.297955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 394/796] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:30 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:30.407795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:30.408553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:30.415027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:30.415505 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:30.415933 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:30.416636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:30.417081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:30.417493 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:30.556569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:30.566553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b011e7e2-093b-429d-9404-aae1b099ece1 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.162545 Aug 25 03:27:30.567136 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 403/797] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:30 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:31.323861 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:31.324478 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:31.331285 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:31.332023 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:31.332557 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:31.333400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:31.333798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:31.334222 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:31.466822 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:31.475598 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:31.477125 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:31.478237 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e046274d-2994-43e0-91e4-b8ed3caa14b1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.158410 Aug 25 03:27:31.478908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 395/798] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:31 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:31.590834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:31.590834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:31.595069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:31.595554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:31.595991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:31.596679 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:31.597160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:31.597582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:31.731318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:31.739115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2ca23398-4cec-4a27-b869-378de6131a97 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.154884 Aug 25 03:27:31.739808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 404/799] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:31 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:31.934816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-395032d7-266d-45a9-a7e5-92756abf4bea req-adb1e523-7e80-4d6a-9dbc-aa4d8d0c2976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b8ac9b-add0-42b0-a55e-842e74995095", "name": "network-vif-plugged", "status": "completed", "tag": "9c839108-8a6d-4e0d-82a1-3d11e580aa98"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:31.949263 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-395032d7-266d-45a9-a7e5-92756abf4bea req-adb1e523-7e80-4d6a-9dbc-aa4d8d0c2976 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:31.949263 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-395032d7-266d-45a9-a7e5-92756abf4bea req-adb1e523-7e80-4d6a-9dbc-aa4d8d0c2976 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:31.949263 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-395032d7-266d-45a9-a7e5-92756abf4bea req-adb1e523-7e80-4d6a-9dbc-aa4d8d0c2976 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:31.959761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-395032d7-266d-45a9-a7e5-92756abf4bea req-adb1e523-7e80-4d6a-9dbc-aa4d8d0c2976 service nova] Creating event network-vif-plugged:9c839108-8a6d-4e0d-82a1-3d11e580aa98 for instance b6b8ac9b-add0-42b0-a55e-842e74995095 on hv-cinder-85164 Aug 25 03:27:31.964977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-395032d7-266d-45a9-a7e5-92756abf4bea req-adb1e523-7e80-4d6a-9dbc-aa4d8d0c2976 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035190 Aug 25 03:27:31.965654 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 396/800] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:32.136818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-393ec776-dc44-46f3-8518-0cc6c1bc2124 req-8b17f25a-4ce0-4757-8fd5-18728e81f50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13340cf-6d9d-48f1-9b26-78bd805f1aed", "tag": "4efa8180-10d5-4eb6-a73b-338c8f8a08e9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:32.147778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-393ec776-dc44-46f3-8518-0cc6c1bc2124 req-8b17f25a-4ce0-4757-8fd5-18728e81f50d service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:32.151705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-393ec776-dc44-46f3-8518-0cc6c1bc2124 req-8b17f25a-4ce0-4757-8fd5-18728e81f50d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:32.151705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-393ec776-dc44-46f3-8518-0cc6c1bc2124 req-8b17f25a-4ce0-4757-8fd5-18728e81f50d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:32.161001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-393ec776-dc44-46f3-8518-0cc6c1bc2124 req-8b17f25a-4ce0-4757-8fd5-18728e81f50d service nova] Creating event network-changed:4efa8180-10d5-4eb6-a73b-338c8f8a08e9 for instance e13340cf-6d9d-48f1-9b26-78bd805f1aed on hv-cinder-85164 Aug 25 03:27:32.166892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-393ec776-dc44-46f3-8518-0cc6c1bc2124 req-8b17f25a-4ce0-4757-8fd5-18728e81f50d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034080 Aug 25 03:27:32.169364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 405/801] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:32.503173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:32.503980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:32.510499 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:32.510980 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:32.511415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:32.512104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:32.512553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:32.512976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:32.643050 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:32.651753 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:32.653284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:32.654414 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fd198892-5977-48c6-970d-2cb64c192a10 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.155577 Aug 25 03:27:32.654972 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 397/802] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:32 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:32.761001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:32.761728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:32.768363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:32.768843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:32.769279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:32.769965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:32.770452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:32.771478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:32.904411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:32.913210 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2c3fc5f0-911a-4f01-a522-bdfd3e915963 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.156320 Aug 25 03:27:32.913800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 406/803] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:32 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:33.676771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:33.677979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:33.684911 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:33.685374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:33.685816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:33.686508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:33.686951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:33.687403 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:33.822069 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:33.830514 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:33.832031 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:33.833673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5ed95eb0-6dfe-4cda-a5c8-76a30403514b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.160506 Aug 25 03:27:33.834248 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 398/804] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:33 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:33.933825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:33.934575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:33.941458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:33.941935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:33.942399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:33.943110 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:33.943555 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:33.943968 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:34.073235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:34.080927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a9ce1966-bf1c-47d2-8aea-1b1796d1df5a tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1363 microversion: 2.1 time: 0.150987 Aug 25 03:27:34.081767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 407/805] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:33 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:34.857034 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:34.857568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:34.864112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:34.865286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:34.865714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:34.866463 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:34.866909 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:34.867324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:34.997610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:35.005911 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:35.007466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:35.008578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-614da2e4-4b68-4ea0-94a8-f817aa2439e1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.155528 Aug 25 03:27:35.009140 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 399/806] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:34 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:27:35.102500 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:35.103121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:35.109587 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:35.110019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:35.110474 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:35.111166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:35.111618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:35.112041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:35.240004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:35.247861 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0f25e4f5-4a88-4cb6-8f66-b5cfbfb33a92 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1549 microversion: 2.1 time: 0.149663 Aug 25 03:27:35.248430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 408/807] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:35 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:35.267976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:35.268480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:35.274937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:35.275414 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:35.275848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:35.276537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:35.276987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:35.277408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:35.353616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e0ce946c-c135-46f0-8040-e6a33d8c8853 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089571 Aug 25 03:27:35.354223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 400/808] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:27:35 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:36.030889 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:36.031592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:36.037503 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:36.038069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:36.038603 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:36.039519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:36.039969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:36.040387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:36.264299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:36.272750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:36.274265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:36.275411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-32eb3749-9cd5-43ca-babc-579b656be599 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.248508 Aug 25 03:27:36.276270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 409/809] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:36 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:36.425191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-f8bd149a-8b6d-4742-8d53-53f91cb52319 req-98cf814f-c27d-4077-b0eb-8767600a4225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b8ac9b-add0-42b0-a55e-842e74995095", "tag": "9c839108-8a6d-4e0d-82a1-3d11e580aa98"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:36.435198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f8bd149a-8b6d-4742-8d53-53f91cb52319 req-98cf814f-c27d-4077-b0eb-8767600a4225 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:36.435670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f8bd149a-8b6d-4742-8d53-53f91cb52319 req-98cf814f-c27d-4077-b0eb-8767600a4225 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:36.436099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-f8bd149a-8b6d-4742-8d53-53f91cb52319 req-98cf814f-c27d-4077-b0eb-8767600a4225 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:36.447305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-f8bd149a-8b6d-4742-8d53-53f91cb52319 req-98cf814f-c27d-4077-b0eb-8767600a4225 service nova] Creating event network-changed:9c839108-8a6d-4e0d-82a1-3d11e580aa98 for instance b6b8ac9b-add0-42b0-a55e-842e74995095 on hv-cinder-85164 Aug 25 03:27:36.452331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-f8bd149a-8b6d-4742-8d53-53f91cb52319 req-98cf814f-c27d-4077-b0eb-8767600a4225 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031440 Aug 25 03:27:36.452932 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 401/810] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:37.297624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:37.298235 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:37.305895 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:37.306398 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:37.306830 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:37.307937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:37.308584 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:37.309167 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:37.458919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:37.467554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:37.469100 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:37.470327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-330d29cd-a6a8-452b-b1f1-ad7a4260de51 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.176716 Aug 25 03:27:37.470907 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 410/811] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:37 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:38.489846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:38.498926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:38.498926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:38.498926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:38.501513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:38.501989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:38.502454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:38.503147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:38.503592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:38.504011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:38.647014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:38.655241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:38.656792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:38.657926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1ecdf6f4-4376-46fd-8c50-dc12b7888b6b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.169552 Aug 25 03:27:38.658526 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 402/812] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:38 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:27:39.680280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:39.680884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:39.682976 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=22 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:39.688081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:39.688555 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:39.693192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:39.693192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:39.693192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:39.693192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:39.825062 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:39.834254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:39.835797 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:39.836933 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f901359c-6998-405a-a90f-99192a3069eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.161173 Aug 25 03:27:39.837498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 411/813] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:39 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:39.940198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-a39c82be-6bd1-4fb0-a875-43c36489ce83 req-d2ea70a2-9c4b-44c2-9ad1-830983cd5a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13340cf-6d9d-48f1-9b26-78bd805f1aed", "name": "network-vif-plugged", "status": "completed", "tag": "4efa8180-10d5-4eb6-a73b-338c8f8a08e9"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:39.945670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:39.951422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-a39c82be-6bd1-4fb0-a875-43c36489ce83 req-d2ea70a2-9c4b-44c2-9ad1-830983cd5a5d service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:39.951898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-a39c82be-6bd1-4fb0-a875-43c36489ce83 req-d2ea70a2-9c4b-44c2-9ad1-830983cd5a5d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:39.952329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-a39c82be-6bd1-4fb0-a875-43c36489ce83 req-d2ea70a2-9c4b-44c2-9ad1-830983cd5a5d service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:39.963813 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-a39c82be-6bd1-4fb0-a875-43c36489ce83 req-d2ea70a2-9c4b-44c2-9ad1-830983cd5a5d service nova] Creating event network-vif-plugged:4efa8180-10d5-4eb6-a73b-338c8f8a08e9 for instance e13340cf-6d9d-48f1-9b26-78bd805f1aed on hv-cinder-85164 Aug 25 03:27:39.968628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-a39c82be-6bd1-4fb0-a875-43c36489ce83 req-d2ea70a2-9c4b-44c2-9ad1-830983cd5a5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032442 Aug 25 03:27:39.969231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 403/814] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:40.860646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:40.861242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:40.868350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:40.868924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:40.869350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:40.870029 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:40.870503 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:40.870917 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:41.003344 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:41.011644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:41.013197 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:41.014337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c6b88783-65fa-4fbf-a42d-8a78ba62f169 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.157956 Aug 25 03:27:41.014896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 412/815] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:40 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:42.038513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:42.039203 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:42.045700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:42.046171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:42.046623 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:42.047327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:42.047772 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:42.048191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:42.175778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:42.184394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:42.185901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:42.187112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-79f2c8af-9795-4cf8-84ee-840554bf4260 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1408 microversion: 2.20 time: 0.153659 Aug 25 03:27:42.187934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 404/816] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:42 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:43.211276 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:43.211881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:43.220337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:43.220819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:43.221250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:43.221948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:43.222511 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:43.222934 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:43.354652 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:43.362897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:43.364406 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:43.365557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7f42388b-dd96-492a-bc55-2b026a918ad8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1601 microversion: 2.20 time: 0.158944 Aug 25 03:27:43.366156 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 413/817] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:27:43 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:27:43.388983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:43.389504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:43.396594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:43.397072 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:43.397503 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:43.398189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:43.398797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:43.399673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:43.474637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fbcae0ce-d014-4928-b6e2-999d71bc3d7d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089777 Aug 25 03:27:43.475342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 405/818] 10.222.0.58 () {60 vars in 1316 bytes} [Thu Aug 25 03:27:43 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:27:44.454011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-2826abc9-9b3e-49d1-bf14-6ccac17c7006 req-964e8374-610a-4a70-8bab-aea790acf5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13340cf-6d9d-48f1-9b26-78bd805f1aed", "tag": "4efa8180-10d5-4eb6-a73b-338c8f8a08e9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:44.459993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:44.465218 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2826abc9-9b3e-49d1-bf14-6ccac17c7006 req-964e8374-610a-4a70-8bab-aea790acf5ad service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:44.465697 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2826abc9-9b3e-49d1-bf14-6ccac17c7006 req-964e8374-610a-4a70-8bab-aea790acf5ad service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:44.466121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-2826abc9-9b3e-49d1-bf14-6ccac17c7006 req-964e8374-610a-4a70-8bab-aea790acf5ad service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:44.479027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-2826abc9-9b3e-49d1-bf14-6ccac17c7006 req-964e8374-610a-4a70-8bab-aea790acf5ad service nova] Creating event network-changed:4efa8180-10d5-4eb6-a73b-338c8f8a08e9 for instance e13340cf-6d9d-48f1-9b26-78bd805f1aed on hv-cinder-85164 Aug 25 03:27:44.484129 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-2826abc9-9b3e-49d1-bf14-6ccac17c7006 req-964e8374-610a-4a70-8bab-aea790acf5ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034102 Aug 25 03:27:44.484952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 414/819] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:45.091510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1931496943"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:45.092743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:45.099797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:45.103147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:45.103147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:45.103147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:45.103147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:45.103497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:45.252756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.network.security_group_api [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Removing security group cf3179d2-ce2c-4618-b883-eb4820f3f3cd from port 74af88e4-8cbe-453a-8e1b-763221404911 Aug 25 03:27:45.640807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fd57b079-2983-4cae-abb0-649583898933 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/action" status: 202 len: 0 microversion: 2.1 time: 0.555317 Aug 25 03:27:45.644640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 406/820] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:27:45 2022] POST /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:27:46.499429 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-3600e698-52bd-422a-a4c4-34b4a763c4d9 req-7d67b92b-56db-4adf-82d0-866d14df5338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53665120-a0da-4bc4-ab99-311a2ba24558", "tag": "74af88e4-8cbe-453a-8e1b-763221404911"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:46.510783 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3600e698-52bd-422a-a4c4-34b4a763c4d9 req-7d67b92b-56db-4adf-82d0-866d14df5338 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:46.511289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3600e698-52bd-422a-a4c4-34b4a763c4d9 req-7d67b92b-56db-4adf-82d0-866d14df5338 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:46.511905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3600e698-52bd-422a-a4c4-34b4a763c4d9 req-7d67b92b-56db-4adf-82d0-866d14df5338 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:46.523325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-3600e698-52bd-422a-a4c4-34b4a763c4d9 req-7d67b92b-56db-4adf-82d0-866d14df5338 service nova] Creating event network-changed:74af88e4-8cbe-453a-8e1b-763221404911 for instance 53665120-a0da-4bc4-ab99-311a2ba24558 on hv-cinder-85164 Aug 25 03:27:46.528122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-3600e698-52bd-422a-a4c4-34b4a763c4d9 req-7d67b92b-56db-4adf-82d0-866d14df5338 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Aug 25 03:27:46.529044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 415/821] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:47.074914 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:47.075512 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:47.082044 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:47.082862 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:47.087048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:47.087048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:47.087048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:47.087048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:47.165732 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lazy-loading 'services' on Instance uuid 53665120-a0da-4bc4-ab99-311a2ba24558 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:27:47.352399 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3edb1dc7-bb08-4285-ac45-6c8e37d3b723 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments/cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c" status: 202 len: 0 microversion: 2.1 time: 0.281747 Aug 25 03:27:47.353167 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 407/822] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:27:47 2022] DELETE /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments/cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:27:47.362692 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:47.365041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:47.372625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:47.375272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:47.375272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:47.375272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:47.375272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:47.375653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:47.404490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5665b70c-1390-4046-806e-72d7ad1526eb tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046743 Aug 25 03:27:47.405050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 416/823] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:27:47 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:48.417842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:48.420147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:48.426210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:48.426707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:48.427821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:48.428482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:48.428923 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:48.429336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:48.456801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7b2d7502-a7da-44d9-a992-e090110d276c tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Aug 25 03:27:48.457343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 408/824] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:27:48 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:48.543639 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-9b68e861-5ae0-4e8f-b2ad-b4515f8be269 req-163f6ad1-a852-4c5f-8229-0f04a09fd448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53665120-a0da-4bc4-ab99-311a2ba24558", "tag": "74af88e4-8cbe-453a-8e1b-763221404911"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:48.553971 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-9b68e861-5ae0-4e8f-b2ad-b4515f8be269 req-163f6ad1-a852-4c5f-8229-0f04a09fd448 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:48.554477 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-9b68e861-5ae0-4e8f-b2ad-b4515f8be269 req-163f6ad1-a852-4c5f-8229-0f04a09fd448 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:48.554911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-9b68e861-5ae0-4e8f-b2ad-b4515f8be269 req-163f6ad1-a852-4c5f-8229-0f04a09fd448 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:48.566175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-9b68e861-5ae0-4e8f-b2ad-b4515f8be269 req-163f6ad1-a852-4c5f-8229-0f04a09fd448 service nova] Creating event network-changed:74af88e4-8cbe-453a-8e1b-763221404911 for instance 53665120-a0da-4bc4-ab99-311a2ba24558 on hv-cinder-85164 Aug 25 03:27:48.571277 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-9b68e861-5ae0-4e8f-b2ad-b4515f8be269 req-163f6ad1-a852-4c5f-8229-0f04a09fd448 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Aug 25 03:27:48.572873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 417/825] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:27:49.469108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:49.471267 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:49.477671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:49.478147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:49.478622 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:49.479306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:49.479754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:49.480174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:49.508420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d02496ae-8406-4d8a-b51d-9d5615622aba tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043325 Aug 25 03:27:49.508985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 409/826] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:27:49 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 03:27:49.520035 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:49.520618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:49.526836 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:49.527317 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:49.527757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:49.528444 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:49.528897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:49.529322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:49.603260 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] HTTP exception thrown: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 is not attached to volume cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Request method failure captured: Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments/cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c HTTP/1.1 Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjButNQHk7Nl0kWxxhIePkkO-ssJ4nfv-n2SubePAB2E0DuIGmbYQilRmKvce-eVbdHzIlv8EvgsqBRbJ2T-xYzKBi387Avf5hewwmXGDHPfIrxrPwNcqszSwcdd35w3yWrq-bvx_MHba2S-mDWHEzLt4qyuQIiF21KG7RED88oP37pnU Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 3e91375fe4114bf98447ccfcb6f8475f Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestMinimumBasicScenario-1357794988 Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:27:49.605637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e91375fe4114bf98447ccfcb6f8475f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e91375fe4114bf98447ccfcb6f8475f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e91375fe4114bf98447ccfcb6f8475f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e91375fe4114bf98447ccfcb6f8475f"}]}] Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestMinimumBasicScenario-1357794988 Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 3e91375fe4114bf98447ccfcb6f8475f Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1357794988 Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-TestMinimumBasicScenario-1357794988-project Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: dd2985023e274f19a868da37aa791859 Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestMinimumBasicScenario-1357794988-project Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:27:49.607332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 is not attached to volume cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'server_id': '53665120-a0da-4bc4-ab99-311a2ba24558', 'id': 'cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c'} Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c. Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:49.608254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 is not attached to volume cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 is not attached to volume cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:27:49.609801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Returning 404 to user: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 is not attached to volume cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:49.610997 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-87e8b047-7ee0-439d-82cc-dd2dffa81bbf tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments/cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c" status: 404 len: 154 microversion: 2.1 time: 0.091439 Aug 25 03:27:49.610997 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 418/827] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:27:49 2022] DELETE /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558/os-volume_attachments/cfbda7ae-c6e0-4dce-9498-6ab4ecd7172c => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:27:50.889261 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:50.889753 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:50.897000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:50.897465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:50.897998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:50.898706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:50.899165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:50.899567 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:50.923001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:27:51.135128 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f3410fee-c053-4e94-974e-31748fdbc762 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 204 len: 0 microversion: 2.1 time: 0.249277 Aug 25 03:27:51.135656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 410/828] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:50 2022] DELETE /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:27:51.144078 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:51.144624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:51.151274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:51.156458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:51.156458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:51.156458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:51.156458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:51.156844 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:51.286179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:51.294400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4090ddbc-b18b-4dfb-8b55-89a771612ae2 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1554 microversion: 2.1 time: 0.154338 Aug 25 03:27:51.294963 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 419/829] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:51 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:52.316811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:52.317543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:52.324502 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:52.324981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:52.325419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:52.326104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:52.326624 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:52.327052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:52.331062 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:52.456019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:52.463585 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3900de5d-7a34-4001-8b38-75fe6be30477 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1554 microversion: 2.1 time: 0.151389 Aug 25 03:27:52.464160 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 411/830] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:52 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:53.484468 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:53.485113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:53.491581 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:53.492057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:53.492491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:53.493171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:53.493619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:53.494038 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:53.625304 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:53.632358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:53.637301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b3911a9-8d66-43f0-b2da-fb84611c96f5 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1554 microversion: 2.1 time: 0.156657 Aug 25 03:27:53.637894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 420/831] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:53 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:54.072310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-bae7097e-331d-494f-aa41-e29396e9fb25 req-e54cccf0-7084-4420-ae91-42a9b3dd9db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53665120-a0da-4bc4-ab99-311a2ba24558", "name": "network-vif-deleted", "tag": "74af88e4-8cbe-453a-8e1b-763221404911"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:54.083039 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-bae7097e-331d-494f-aa41-e29396e9fb25 req-e54cccf0-7084-4420-ae91-42a9b3dd9db5 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:54.083513 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-bae7097e-331d-494f-aa41-e29396e9fb25 req-e54cccf0-7084-4420-ae91-42a9b3dd9db5 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:54.083969 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-bae7097e-331d-494f-aa41-e29396e9fb25 req-e54cccf0-7084-4420-ae91-42a9b3dd9db5 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:54.094770 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-bae7097e-331d-494f-aa41-e29396e9fb25 req-e54cccf0-7084-4420-ae91-42a9b3dd9db5 service nova] Creating event network-vif-deleted:74af88e4-8cbe-453a-8e1b-763221404911 for instance 53665120-a0da-4bc4-ab99-311a2ba24558 on hv-cinder-85164 Aug 25 03:27:54.099698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-bae7097e-331d-494f-aa41-e29396e9fb25 req-e54cccf0-7084-4420-ae91-42a9b3dd9db5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031670 Aug 25 03:27:54.100469 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 412/832] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:54.659659 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:54.660271 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:54.667175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:54.667670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:54.668094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:54.668778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:54.669232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:54.669654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:54.701162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:54.701647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:54.702109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:54.702585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lazy-loading 'fault' on Instance uuid 53665120-a0da-4bc4-ab99-311a2ba24558 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:27:54.747276 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2985023e274f19a868da37aa791859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e91375fe4114bf98447ccfcb6f8475f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:54.755212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cbdf5470-3996-4ace-a871-10f6abc3418e tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 200 len: 1348 microversion: 2.1 time: 0.099818 Aug 25 03:27:54.755800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 421/833] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:54 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:55.777004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:55.777700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] [instance: 53665120-a0da-4bc4-ab99-311a2ba24558] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:55.784758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:55.785239 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:55.785675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:55.786392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:55.787335 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:55.787754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:55.800694 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] HTTP exception thrown: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 could not be found. Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Request method failure captured: Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 HTTP/1.1 Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjButNQHk7Nl0kWxxhIePkkO-ssJ4nfv-n2SubePAB2E0DuIGmbYQilRmKvce-eVbdHzIlv8EvgsqBRbJ2T-xYzKBi387Avf5hewwmXGDHPfIrxrPwNcqszSwcdd35w3yWrq-bvx_MHba2S-mDWHEzLt4qyuQIiF21KG7RED88oP37pnU Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 3e91375fe4114bf98447ccfcb6f8475f Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-TestMinimumBasicScenario-1357794988 Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:27:55.803018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e91375fe4114bf98447ccfcb6f8475f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e91375fe4114bf98447ccfcb6f8475f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e91375fe4114bf98447ccfcb6f8475f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e91375fe4114bf98447ccfcb6f8475f"}]}] Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-TestMinimumBasicScenario-1357794988 Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 3e91375fe4114bf98447ccfcb6f8475f Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1357794988 Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-TestMinimumBasicScenario-1357794988-project Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: dd2985023e274f19a868da37aa791859 Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-TestMinimumBasicScenario-1357794988-project Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 could not be found. Aug 25 03:27:55.804620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '53665120-a0da-4bc4-ab99-311a2ba24558'} Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 could not be found. Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:55.805429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 could not be found. Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 could not be found. Aug 25 03:27:55.806706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:27:55.807864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Returning 404 to user: Instance 53665120-a0da-4bc4-ab99-311a2ba24558 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:55.807864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-177cf684-5ba8-44e2-930b-4b178c67f832 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558" status: 404 len: 111 microversion: 2.1 time: 0.031738 Aug 25 03:27:55.807864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 413/834] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:55 2022] GET /compute/v2.1/servers/53665120-a0da-4bc4-ab99-311a2ba24558 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:55.813246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-93cdf649-4d3b-4789-8ec3-2a8713caf915 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] Calling method '.version_select at 0x7fa33df8daf0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:55.895387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-93cdf649-4d3b-4789-8ec3-2a8713caf915 tempest-TestMinimumBasicScenario-1357794988 tempest-TestMinimumBasicScenario-1357794988-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-874095792" status: 202 len: 0 microversion: 2.1 time: 0.086018 Aug 25 03:27:55.895893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 422/835] 10.222.0.58 () {58 vars in 1269 bytes} [Thu Aug 25 03:27:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-874095792 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:28:58.700714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:28:58.701261 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:28:58.704417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:28:58.705394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=8 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:28:58.710105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:28:58.710658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:28:58.715426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:28:58.715426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:28:58.715426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:28:58.715426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:28:58.736840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1d42e1dc-1400-4f38-ad48-81d6c439be52 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/ips" status: 200 len: 150 microversion: 2.1 time: 0.042003 Aug 25 03:28:58.738417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 414/836] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:28:58 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:03.490722 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=8 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:03.491475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:03.496262 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d46a1f5-6e9c-4cd6-ae3d-591841b18aea"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:03.500329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:03.507446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:03.507935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:03.508371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:03.509068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:03.509522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:03.509957 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:04.377128 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1a0efdc1-4e9a-4e45-830f-05145a615fcd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888873 Aug 25 03:29:04.377776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 423/837] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:29:03 2022] POST /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:09.525514 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-513169755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-906870696", "security_groups": [{"name": "tempest-secgroup-smoke-124869442"}], "block_device_mapping_v2": [{"uuid": "526c6ad3-6a9a-41ae-bfc6-9f9041ce1983", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "444723d5-7c16-4c26-8712-31f648699b2b"}]}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:09.692768 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] validate_networks() for [('444723d5-7c16-4c26-8712-31f648699b2b', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:29:10.074483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:29:10.075010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:29:10.075483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:29:10.075888 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:29:10.076293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:29:10.085021 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:10.085491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:10.085916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:10.086670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:10.087115 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:10.087529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:10.103718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for project 5d445535a4974186a835ab117109dca1. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:29:10.110137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Getting quotas for user d0a0e9c327564a3db8b89ea706f0fb36 and project 5d445535a4974186a835ab117109dca1. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:29:10.162748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:29:10.164984 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='526c6ad3-6a9a-41ae-bfc6-9f9041ce1983',volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:29:10.494879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fd5726a3-0958-427b-a273-3f2b65339b73 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.973755 Aug 25 03:29:10.495540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 415/838] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:29:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:29:10.507960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e2a2dfd1-062b-497f-b086-8283c8462df9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:10.508660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e2a2dfd1-062b-497f-b086-8283c8462df9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:10.562620 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e2a2dfd1-062b-497f-b086-8283c8462df9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:10.569432 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e2a2dfd1-062b-497f-b086-8283c8462df9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1093 microversion: 2.1 time: 0.066182 Aug 25 03:29:10.570033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 424/839] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:10 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:11.591986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:11.592608 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:11.598629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:11.599104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:11.599536 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:11.600223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:11.600670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:11.601092 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:11.663370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:11.671100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4dc29725-c32d-4f3e-8ca2-281fcb7bbe00 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1135 microversion: 2.1 time: 0.084338 Aug 25 03:29:11.671670 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 416/840] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:11 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1135 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:12.691951 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:12.692665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:12.700676 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:12.701159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:12.701665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:12.702400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:12.702858 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:12.703286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:12.766939 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:12.774496 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7dbc76de-d70f-4a52-8279-9d79dbbe089c tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1199 microversion: 2.1 time: 0.086390 Aug 25 03:29:12.781400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 425/841] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:12 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:13.795265 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:13.795870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:13.802210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:13.802718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:13.803148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:13.803841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:13.804290 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:13.804706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:13.947308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:13.955840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-eb9915e1-d808-48ba-877c-167a5c60fb60 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1276 microversion: 2.1 time: 0.164910 Aug 25 03:29:13.956775 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 417/842] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:13 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:14.177598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-b274342e-a249-42b3-be52-fa63f233c273 req-9b264510-c740-43f9-ad34-c92894869ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c442dfda-aec1-4ed6-aef9-3d6bfa001a70", "tag": "04db698f-a8f7-4531-90b3-5397940c09b3"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:14.189443 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b274342e-a249-42b3-be52-fa63f233c273 req-9b264510-c740-43f9-ad34-c92894869ae8 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:14.189919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b274342e-a249-42b3-be52-fa63f233c273 req-9b264510-c740-43f9-ad34-c92894869ae8 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:14.190371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-b274342e-a249-42b3-be52-fa63f233c273 req-9b264510-c740-43f9-ad34-c92894869ae8 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:14.202273 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-b274342e-a249-42b3-be52-fa63f233c273 req-9b264510-c740-43f9-ad34-c92894869ae8 service nova] Creating event network-changed:04db698f-a8f7-4531-90b3-5397940c09b3 for instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 on hv-cinder-85164 Aug 25 03:29:14.207747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-b274342e-a249-42b3-be52-fa63f233c273 req-9b264510-c740-43f9-ad34-c92894869ae8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034533 Aug 25 03:29:14.208557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 426/843] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:14.976975 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:14.977629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:14.984152 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:14.984632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:14.985065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:14.985762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:14.986414 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:14.986658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:15.115903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:15.124380 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e0705ffa-7983-4ce7-8bea-3ce79f3f313a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1276 microversion: 2.1 time: 0.151379 Aug 25 03:29:15.124956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 418/844] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:14 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:16.145821 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:16.147181 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:16.155357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:16.156082 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:16.156731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:16.157570 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:16.157912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:16.158368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:16.294350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:16.301931 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0685961e-12b1-4e18-b71c-3e4f8f5f6ffe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1276 microversion: 2.1 time: 0.160782 Aug 25 03:29:16.309217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 427/845] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:16 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:17.190633 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d46a1f5-6e9c-4cd6-ae3d-591841b18aea"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:17.193126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:17.200345 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.200821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.201253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.201952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.202436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.202863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.298107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Invalid volume: volume 3d46a1f5-6e9c-4cd6-ae3d-591841b18aea is already attached to instances: 8e63fffa-925d-4288-b5b9-1ce22da25b57 Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: POST /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments HTTP/1.1 Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 74 Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:29:17.299734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {"volumeAttachment": {"volumeId": "3d46a1f5-6e9c-4cd6-ae3d-591841b18aea"}} Aug 25 03:29:17.301468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Invalid volume: volume 3d46a1f5-6e9c-4cd6-ae3d-591841b18aea is already attached to instances: 8e63fffa-925d-4288-b5b9-1ce22da25b57 Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'server_id': '8e63fffa-925d-4288-b5b9-1ce22da25b57', 'body': {'volumeAttachment': {'volumeId': '3d46a1f5-6e9c-4cd6-ae3d-591841b18aea'}}} Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3d46a1f5-6e9c-4cd6-ae3d-591841b18aea is already attached to instances: 8e63fffa-925d-4288-b5b9-1ce22da25b57 Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:17.302655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3d46a1f5-6e9c-4cd6-ae3d-591841b18aea is already attached to instances: 8e63fffa-925d-4288-b5b9-1ce22da25b57 Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:17.304154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3d46a1f5-6e9c-4cd6-ae3d-591841b18aea is already attached to instances: 8e63fffa-925d-4288-b5b9-1ce22da25b57 Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 400 to user: Invalid volume: volume 3d46a1f5-6e9c-4cd6-ae3d-591841b18aea is already attached to instances: 8e63fffa-925d-4288-b5b9-1ce22da25b57 {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d35b6b01-8b85-4e78-aa0c-4ba00067ca95 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114738 Aug 25 03:29:17.305747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 419/846] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:29:17 2022] POST /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:29:17.323560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:17.324209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:17.332394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.332881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.333315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.334012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.334496 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.334921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.373349 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:17.374563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:17.383828 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.384314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.384753 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.385458 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.385909 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.386366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.479058 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:17.487938 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lazy-loading 'services' on Instance uuid 8e63fffa-925d-4288-b5b9-1ce22da25b57 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:29:17.488119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c97941d5-226e-44c4-b47f-8c6c7aeab669 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1276 microversion: 2.1 time: 0.168287 Aug 25 03:29:17.488937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 428/847] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:17 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:17.681099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4309f596-fcd3-4e58-bdf0-013b3e79c97e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments/3d46a1f5-6e9c-4cd6-ae3d-591841b18aea" status: 202 len: 0 microversion: 2.1 time: 0.315253 Aug 25 03:29:17.681628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 420/848] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:29:17 2022] DELETE /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments/3d46a1f5-6e9c-4cd6-ae3d-591841b18aea => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:29:17.692064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:17.694369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:17.700237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.700705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.701130 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.701844 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:17.702307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:17.702721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:17.732103 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-de84a1e4-a643-4167-9e7b-614b2fb9055c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Aug 25 03:29:17.732651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 429/849] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:17 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:18.509977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:18.510702 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:18.517879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:18.518412 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:18.519027 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:18.519727 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:18.520176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:18.520597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:18.665026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:18.672949 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-60350681-453c-4d6a-afc5-c9dd00dc93da tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.167191 Aug 25 03:29:18.673619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 421/850] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:18 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:18.743856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:18.746030 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:18.752887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:18.753367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:18.753804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:18.754552 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:18.755009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:18.755433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:18.784868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0af68611-e276-4e7e-b63d-579e0be0a22f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Aug 25 03:29:18.785361 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 430/851] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:18 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:18.943814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:18.944395 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:18.950863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:18.951413 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:18.951844 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:18.952534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:18.952976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:18.953460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:18.979527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-20eeedb8-a45c-4bce-846e-7df5ae8ad4dc tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/ips" status: 200 len: 146 microversion: 2.1 time: 0.183342 Aug 25 03:29:18.980081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 422/852] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:29:18 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/ips => generated 146 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:19.694551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:19.695423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:19.701972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:19.706903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:19.706903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:19.706903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:19.706903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:19.707372 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:19.797695 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:19.799989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:19.807190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:19.807671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:19.808100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:19.809379 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:19.809836 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:19.810419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:19.842140 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-04d0a59e-2f99-4724-b6e3-1df093d57ae3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048832 Aug 25 03:29:19.843073 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 423/853] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:19 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:19.850514 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:19.856740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-473f6eff-fc3b-44c1-9f4b-973fd69ba1a7 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.166229 Aug 25 03:29:19.857308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 431/854] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:19 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:20.854529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:20.857416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:20.859384 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:20.860033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:20.865143 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:20.865667 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:20.866094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:20.866808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:20.867251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:20.867689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:20.877092 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:20.877699 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:20.879882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:20.885279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:20.885760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:20.886195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:20.886928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:20.887385 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:20.887811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:20.897375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8aea7531-a11b-41fc-9358-b79427b752da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046775 Aug 25 03:29:20.897947 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 424/855] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:20 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:21.021758 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:21.029643 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8516532a-f2e9-41f0-9d5c-254ecbad1dde tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.156406 Aug 25 03:29:21.030216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 432/856] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:20 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:21.602545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa2566d4-077b-4820-a1c0-202d204e84e6"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:21.604882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:21.611779 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:21.612257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:21.612692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:21.613382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:21.613832 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:21.614254 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:21.910094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:21.912267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:21.919295 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:21.924738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:21.924738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:21.924738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:21.924738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:21.925124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:21.950394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b3d51a47-8ceb-4265-b5f6-95f02c8d883e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044475 Aug 25 03:29:21.950958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 433/857] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:21 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 03:29:22.015305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:22.015795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:22.021797 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:22.022270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:22.022723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:22.023404 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:22.023847 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:22.024261 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:22.049673 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:29:22.304736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-69218fc0-ef92-4336-87da-62481544fd03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 204 len: 0 microversion: 2.1 time: 0.293062 Aug 25 03:29:22.305336 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 434/858] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:29:22 2022] DELETE /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:29:22.310783 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:22.315796 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:22.317309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:22.317792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:22.318224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:22.318991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:22.319443 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:22.319867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:22.393703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6b0d5586-413d-413c-bed9-9d621f00d090 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794876 Aug 25 03:29:22.394742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 425/859] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:29:21 2022] POST /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:22.399965 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:22.400673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:22.407699 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:22.408188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:22.408626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:22.409366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:22.409816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:22.410476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:22.471704 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:22.479517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-42a13ea9-205d-42c1-ad23-67577000524a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.172995 Aug 25 03:29:22.480180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 435/860] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:22 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:22.553395 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:22.561893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0b9ce906-de55-4871-82ed-2f23249bfccd tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1681 microversion: 2.1 time: 0.166063 Aug 25 03:29:22.562485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 426/861] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:22 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:23.501535 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:23.502159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:23.508788 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:23.509277 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:23.509715 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:23.510442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:23.510902 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:23.511326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:23.583344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:23.584006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:23.590340 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:23.590819 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:23.591253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:23.591946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:23.592400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:23.592823 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:23.668360 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:23.676582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1a444923-4666-4510-b7a6-ccdee42a0ff6 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.179845 Aug 25 03:29:23.677161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 436/862] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:23 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:23.736487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:23.747038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e73ad9e8-c22b-4d36-b517-72d46e9e0d81 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1681 microversion: 2.1 time: 0.164584 Aug 25 03:29:23.747038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 427/863] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:23 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:24.696913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:24.697507 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:24.705054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:24.707278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:24.707278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:24.707278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:24.707278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:24.707705 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:24.765958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:24.766548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:24.773136 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:24.773618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:24.774054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:24.774778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:24.775233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:24.775657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:24.870315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:24.878831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d7ab9da4-3db6-47d3-9eb3-6694a4150ea9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.185806 Aug 25 03:29:24.880120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 437/864] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:24 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:24.928710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:24.937337 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3429c50d-353f-44bf-a7f7-2291c9e88155 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1681 microversion: 2.1 time: 0.176232 Aug 25 03:29:24.937909 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 428/865] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:24 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:25.899199 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:25.899813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:25.906258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:25.906765 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:25.907202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:25.907888 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:25.908387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:25.908813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:25.912912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:25.958439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:25.959033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:25.965410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:25.965884 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:25.966881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:25.967576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:25.968025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:25.968444 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:26.079892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:26.087597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4aa88278-b94d-4e40-87af-fc27783ab587 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.192201 Aug 25 03:29:26.088176 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 438/866] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:25 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:26.126233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:26.129792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:26.134501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4bfbb218-6ccd-4a6d-9864-6aebecfdc597 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1681 microversion: 2.1 time: 0.179921 Aug 25 03:29:26.135079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 429/867] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:25 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:26.698615 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:26.699111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:26.705053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:26.705536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:26.705964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:26.706691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:26.707138 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:26.707559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:26.731877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e134a4c3-1ff2-43f0-b5ce-379a04b6b964 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/ips" status: 200 len: 153 microversion: 2.20 time: 0.037170 Aug 25 03:29:26.739231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 439/868] 10.222.0.58 () {60 vars in 1289 bytes} [Thu Aug 25 03:29:26 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:29:27.111563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:27.113142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:27.125876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.128788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.140350 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.141229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.144451 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.144903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.156307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:27.156913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:27.167025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.168303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.169803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.171710 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.172717 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.173314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.281433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:27.289547 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-736594b8-c899-43c2-ab95-9a1fa47ad5b1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1614 microversion: 2.1 time: 0.136921 Aug 25 03:29:27.298332 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 440/869] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:27 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1614 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:27.354945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:27.363397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4d6cbf27-1a82-4b11-afeb-7a40fcc7b2bb tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.257316 Aug 25 03:29:27.381820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 430/870] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:27 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:27.410928 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-d8cd6308-430b-4994-9ff6-f3e92c6dfd99 req-36972309-836e-4be1-87e6-2e312617dea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e63fffa-925d-4288-b5b9-1ce22da25b57", "name": "network-vif-deleted", "tag": "6ac885d7-37db-4141-9d71-a376b3b82292"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:27.421723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d8cd6308-430b-4994-9ff6-f3e92c6dfd99 req-36972309-836e-4be1-87e6-2e312617dea4 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.422207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d8cd6308-430b-4994-9ff6-f3e92c6dfd99 req-36972309-836e-4be1-87e6-2e312617dea4 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.422669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d8cd6308-430b-4994-9ff6-f3e92c6dfd99 req-36972309-836e-4be1-87e6-2e312617dea4 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.435725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-d8cd6308-430b-4994-9ff6-f3e92c6dfd99 req-36972309-836e-4be1-87e6-2e312617dea4 service nova] Creating event network-vif-deleted:6ac885d7-37db-4141-9d71-a376b3b82292 for instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 on hv-cinder-85164 Aug 25 03:29:27.441686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-d8cd6308-430b-4994-9ff6-f3e92c6dfd99 req-36972309-836e-4be1-87e6-2e312617dea4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034350 Aug 25 03:29:27.442709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 441/871] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:27.815834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:27.817951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:27.824311 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.824789 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.825246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.826488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.826934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.827376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.857564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d8812232-277f-403a-9f3a-b4956e88aa1e tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Aug 25 03:29:27.860898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 431/872] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:27 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:27.869518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:27.870088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:27.876272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.876749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.877186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.878328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:27.878848 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:27.879340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:27.909839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-24dff053-1795-4dd9-9a46-845974f34007 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/aa2566d4-077b-4820-a1c0-202d204e84e6" status: 200 len: 194 microversion: 2.1 time: 0.044518 Aug 25 03:29:27.910411 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 442/873] 10.222.0.58 () {58 vars in 1413 bytes} [Thu Aug 25 03:29:27 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/aa2566d4-077b-4820-a1c0-202d204e84e6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:28.317638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:28.318641 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:28.327475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:28.328266 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:28.328915 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:28.329637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:28.330089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:28.330555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:28.370967 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:28.371453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:28.371889 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:28.372342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lazy-loading 'fault' on Instance uuid 8e63fffa-925d-4288-b5b9-1ce22da25b57 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:29:28.384862 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:28.386105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:28.394067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:28.397053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:28.397053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:28.397053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:28.397053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:28.397554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:28.425852 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:28.437989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2a64e1e2-de75-42db-bc36-e049b61acc3e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 200 len: 1331 microversion: 2.1 time: 0.125497 Aug 25 03:29:28.438632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 432/874] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:28 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:28.629821 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:28.637426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f26fe435-70dc-402c-bcb9-c4081232ad3b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.256282 Aug 25 03:29:28.639028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 443/875] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:28 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:28.667946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-9b762ebf-2b3a-4ebc-9be8-e94fe9986249 req-2eabd89b-1d40-44d5-986f-9f8c81b1144b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c442dfda-aec1-4ed6-aef9-3d6bfa001a70", "name": "network-vif-plugged", "status": "completed", "tag": "04db698f-a8f7-4531-90b3-5397940c09b3"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:28.680440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9b762ebf-2b3a-4ebc-9be8-e94fe9986249 req-2eabd89b-1d40-44d5-986f-9f8c81b1144b service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:28.681200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9b762ebf-2b3a-4ebc-9be8-e94fe9986249 req-2eabd89b-1d40-44d5-986f-9f8c81b1144b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:28.681828 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-9b762ebf-2b3a-4ebc-9be8-e94fe9986249 req-2eabd89b-1d40-44d5-986f-9f8c81b1144b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:28.696962 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-9b762ebf-2b3a-4ebc-9be8-e94fe9986249 req-2eabd89b-1d40-44d5-986f-9f8c81b1144b service nova] Creating event network-vif-plugged:04db698f-a8f7-4531-90b3-5397940c09b3 for instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 on hv-cinder-85164 Aug 25 03:29:28.703391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-9b762ebf-2b3a-4ebc-9be8-e94fe9986249 req-2eabd89b-1d40-44d5-986f-9f8c81b1144b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040692 Aug 25 03:29:28.704003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 433/876] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:29.460707 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:29.461314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:29.468348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:29.468819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:29.469245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:29.469918 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:29.470387 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:29.470799 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:29.483700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 HTTP/1.1 Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:29:29.485284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:29:29.486911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '8e63fffa-925d-4288-b5b9-1ce22da25b57'} Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:29:29.487769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:29:29.489278 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:29.490742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:29:29.490742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c9c7c4b9-82f0-4f27-b495-8f9b459e9c05 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 404 len: 111 microversion: 2.1 time: 0.029813 Aug 25 03:29:29.490742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 444/877] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:29 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:29:29.495805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-60dedfbf-59b5-4406-9a64-d73c4cac99f6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '.version_select at 0x7fa33a6218b0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:29.602248 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-60dedfbf-59b5-4406-9a64-d73c4cac99f6 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783583290" status: 202 len: 0 microversion: 2.1 time: 0.110400 Aug 25 03:29:29.602890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 434/878] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Aug 25 03:29:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783583290 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:29:29.664245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:29.665025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:29.672057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:29.672546 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:29.672987 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:29.673743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:29.674199 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:29.674658 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:29.836075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:29.844187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a7f96cbe-a921-422a-9adf-365fe47283fe tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.184080 Aug 25 03:29:29.844789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 445/879] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:29 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:30.147586 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:30.148317 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:30.155272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.155751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.156182 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:30.156871 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.157320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.158397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:30.180675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lazy-loading 'flavor' on Instance uuid e13340cf-6d9d-48f1-9b26-78bd805f1aed {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:29:30.421028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-569a89d1-61ed-4c84-81c6-2c5cb6c33bb1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: .version_select at 0x7fa33dfb1430>, body: {"keypair": {"name": "tempest-keypair-1338019545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLksTak75SidQ8s1Z8HDY2PdNJEfvZO4mzzAqKUMik9zjOCr3PjAmxDotWoIprkMKYsAVTdFgx0XFhnIq4qJ9T2ifQn4+kqfgqx5haQvXLr7BAf+qbR1n4qlO9UIkbu3gg=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:30.436883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-569a89d1-61ed-4c84-81c6-2c5cb6c33bb1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:29:30.440749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-569a89d1-61ed-4c84-81c6-2c5cb6c33bb1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:29:30.533895 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-569a89d1-61ed-4c84-81c6-2c5cb6c33bb1 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117248 Aug 25 03:29:30.534569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 446/880] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:29:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:30.623526 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ca22411e-ec5b-46c8-a17d-f3f7d33b1b7c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/action" status: 202 len: 0 microversion: 2.20 time: 0.480238 Aug 25 03:29:30.624131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 435/881] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Aug 25 03:29:30 2022] POST /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:29:30.632395 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:30.633007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:30.640291 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.642349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.642349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:30.642349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.642618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.642910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:30.752712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66bd5472-0099-42c1-b6a1-6d18612166fc"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:30.755163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:30.762170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.762679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.763776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:30.764506 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.764990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.765439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:30.792320 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:30.802390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:30.803905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:30.805086 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fcd49a4f-b451-4579-8305-5966af46a8df tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.176651 Aug 25 03:29:30.805794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 447/882] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:30 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:30.864584 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:30.865193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:30.871231 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.871707 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.872141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:30.873481 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:30.873932 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:30.874380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:31.011786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:31.024544 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a69d2b3e-eaac-4047-ba11-a7f2479642e9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1264 microversion: 2.1 time: 0.163755 Aug 25 03:29:31.025140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 448/883] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:30 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:31.828962 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:31.829723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:31.836307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:31.836785 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:31.837220 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:31.837904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:31.838383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:31.839519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:31.979344 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:31.989152 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:31.990687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:31.991880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b326a5ab-90cd-425b-8beb-a42d4621896b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.166891 Aug 25 03:29:31.992446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 449/884] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:31 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:32.045659 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:32.046288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:32.052582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:32.053074 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:32.053526 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:32.054218 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:32.054702 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:32.055126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:32.193454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:32.194566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ffb53664-ca1e-489d-9f49-9848001a2758 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "POST /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.445705 Aug 25 03:29:32.195415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 436/885] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:29:30 2022] POST /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments => generated 194 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:32.203784 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0c2a4545-2e39-4a72-b91b-070641017eaf tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1450 microversion: 2.1 time: 0.162180 Aug 25 03:29:32.204768 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 450/886] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:32 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:32.234171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:32.234842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:32.241855 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:32.242448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:32.242933 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:32.243707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:32.244469 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:32.244767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:32.389593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:32.397782 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-49804c82-216f-45d3-8a6a-29e34b73321f tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1450 microversion: 2.1 time: 0.170527 Aug 25 03:29:32.398372 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 437/887] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:32 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:33.015751 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:33.016493 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:33.023672 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:33.024158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:33.024595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:33.025294 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:33.025746 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:33.026230 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:33.157394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:33.166700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:33.171071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:33.171071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c3554424-fc58-4166-b266-06a71522125b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.158276 Aug 25 03:29:33.171071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 451/888] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:33 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:33.394804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-593578586", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "256737dd-9a94-4238-9f74-9979facae111"}], "security_groups": [{"name": "tempest-securitygroup--1341650496"}], "key_name": "tempest-keypair-1338019545", "user_data": "}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:33.497012 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] validate_networks() for [('256737dd-9a94-4238-9f74-9979facae111', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:29:33.872745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:29:33.873293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:29:33.873771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:29:33.874188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:29:33.874626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:29:33.883476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:33.883955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:33.884397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:33.885132 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:33.885605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:33.886030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:33.903204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:29:33.907746 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Getting quotas for user 68b69b25b19a4addb9aff7fb7a710e56 and project a48e4c9aca394fc1a3bb497c26f2a9f1. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:29:33.919460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:29:33.921788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:29:34.042082 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6eed04c8-0adc-493b-8157-43782d56c70f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.656284 Aug 25 03:29:34.042759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 438/889] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:29:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:29:34.054191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-041a672d-2994-4a5c-9194-a87bdfa624ad tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:34.054899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-041a672d-2994-4a5c-9194-a87bdfa624ad tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:34.057771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:34.114505 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-041a672d-2994-4a5c-9194-a87bdfa624ad tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:34.123365 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-041a672d-2994-4a5c-9194-a87bdfa624ad tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1241 microversion: 2.1 time: 0.073226 Aug 25 03:29:34.124310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 452/890] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:34 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:34.207847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:34.208467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:34.214952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:34.215954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:34.217249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:34.217976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:34.218440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:34.218859 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:34.357796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:34.372130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:34.372130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:34.372972 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fa147f6d-28f5-4c77-86d9-8a53ae89e65f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.181527 Aug 25 03:29:34.373540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 439/891] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:34 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:34.737155 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-d4f934dc-7f5f-4f61-a77f-fe93a9648f80 req-1b0a2bbc-fe3e-4f7a-9a40-73505db88981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c442dfda-aec1-4ed6-aef9-3d6bfa001a70", "tag": "04db698f-a8f7-4531-90b3-5397940c09b3"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:34.751695 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d4f934dc-7f5f-4f61-a77f-fe93a9648f80 req-1b0a2bbc-fe3e-4f7a-9a40-73505db88981 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:34.752591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d4f934dc-7f5f-4f61-a77f-fe93a9648f80 req-1b0a2bbc-fe3e-4f7a-9a40-73505db88981 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:34.753311 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d4f934dc-7f5f-4f61-a77f-fe93a9648f80 req-1b0a2bbc-fe3e-4f7a-9a40-73505db88981 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:34.765804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-d4f934dc-7f5f-4f61-a77f-fe93a9648f80 req-1b0a2bbc-fe3e-4f7a-9a40-73505db88981 service nova] Creating event network-changed:04db698f-a8f7-4531-90b3-5397940c09b3 for instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 on hv-cinder-85164 Aug 25 03:29:34.771392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-d4f934dc-7f5f-4f61-a77f-fe93a9648f80 req-1b0a2bbc-fe3e-4f7a-9a40-73505db88981 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041200 Aug 25 03:29:34.772739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 453/892] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:35.146895 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:35.147712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:35.155029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:35.155879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:35.156508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:35.157526 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:35.158143 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:35.158928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:35.236321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:35.244649 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2cd8c2ae-0133-438d-a0e9-aa336771224d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1245 microversion: 2.1 time: 0.103315 Aug 25 03:29:35.245233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 440/893] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:35 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:35.399270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:35.400146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:35.408108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:35.408646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:35.409113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:35.410249 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:35.410650 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:35.411072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:35.575036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:35.580218 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:35.582094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:35.583380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b713d24d-bd17-41a0-a825-f356ddea4cfe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.191226 Aug 25 03:29:35.584027 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 454/894] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:35 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:36.265803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:36.266637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:36.272879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:36.273352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:36.273778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:36.274492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:36.274946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:36.275356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:36.347879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:36.356037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1166e25c-b230-4529-8b33-f105669cbac0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1301 microversion: 2.1 time: 0.094083 Aug 25 03:29:36.357305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 441/895] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:36 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:36.606568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:36.607297 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:36.613716 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:36.614185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:36.614641 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:36.615326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:36.615770 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:36.616178 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:36.995890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:37.005379 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:37.006926 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:37.008241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2fcc0add-ab5e-4ac1-a8fd-9866e1a82af5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.405702 Aug 25 03:29:37.008803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 455/896] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:36 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:37.379299 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:37.379905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:37.386386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:37.386890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:37.387362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:37.388058 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:37.388500 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:37.389026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:37.520599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:37.528310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-54dd6f31-1ecc-4fa6-9082-b46c7257c957 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.153055 Aug 25 03:29:37.528971 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 442/897] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:37 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:37.908683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-22a8bc9c-e4b0-4e8f-b62e-d7e2ac80b613 req-484ceac8-f1ef-4e93-b9d0-5b81cf5ac669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454d5736-82fe-47b0-a508-0fb6bddd1a9c", "tag": "a9d9c369-cdd0-4501-a5a6-1f2bea0df716"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:37.920408 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-22a8bc9c-e4b0-4e8f-b62e-d7e2ac80b613 req-484ceac8-f1ef-4e93-b9d0-5b81cf5ac669 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:37.920871 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-22a8bc9c-e4b0-4e8f-b62e-d7e2ac80b613 req-484ceac8-f1ef-4e93-b9d0-5b81cf5ac669 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:37.921326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-22a8bc9c-e4b0-4e8f-b62e-d7e2ac80b613 req-484ceac8-f1ef-4e93-b9d0-5b81cf5ac669 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:37.938568 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-22a8bc9c-e4b0-4e8f-b62e-d7e2ac80b613 req-484ceac8-f1ef-4e93-b9d0-5b81cf5ac669 service nova] Creating event network-changed:a9d9c369-cdd0-4501-a5a6-1f2bea0df716 for instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c on hv-cinder-85164 Aug 25 03:29:37.939672 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-22a8bc9c-e4b0-4e8f-b62e-d7e2ac80b613 req-484ceac8-f1ef-4e93-b9d0-5b81cf5ac669 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034612 Aug 25 03:29:37.940434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 456/898] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:38.031753 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:38.032543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:38.038531 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:38.039041 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:38.039433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:38.040128 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:38.040580 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:38.041003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:38.175632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:38.183733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:38.186045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:38.187238 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8e5fc7ea-a9e7-47f7-875c-30a1cd85ae0b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.159520 Aug 25 03:29:38.187815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 443/899] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:38 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:38.549974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:38.550696 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:38.557809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:38.558307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:38.558739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:38.559421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:38.560764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:38.561189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:38.690465 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:38.697958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a6bea059-cb4a-421c-b80e-39c1d3abde6e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.152197 Aug 25 03:29:38.698551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 457/900] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:38 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:39.210678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:39.211288 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:39.217825 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:39.218324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:39.218763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:39.219452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:39.219904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:39.220327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:39.348501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:39.357139 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:39.358682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:39.359847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-614f3eac-99b6-4c91-89c1-3e26fbf92e9b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.153153 Aug 25 03:29:39.360415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 444/901] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:39 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:39.718610 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:39.719224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:39.725346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:39.725824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:39.726260 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:39.726970 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:39.727421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:39.727855 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:39.864508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:39.872953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-447fe236-1b11-4144-81e9-a2e7b5c5f0d8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.157688 Aug 25 03:29:39.873529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 458/902] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:39 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:40.383537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:40.384147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:40.387018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:40.391681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:40.392147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:40.392599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:40.393282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:40.393721 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:40.394135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:40.398059 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:40.528164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:40.536150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:40.540370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:40.540370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ee699a7f-d1a1-4ac1-822b-17ed3b8d27fc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.159194 Aug 25 03:29:40.540370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 445/903] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:40 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:40.893461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:40.894120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:40.900801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:40.901270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:40.901693 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:40.902394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:40.902837 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:40.903250 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:41.037654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:41.041213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=100 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:41.046563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e4400569-1d23-40a0-adf0-ff89e8a06ecf tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.157315 Aug 25 03:29:41.049580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 459/904] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:40 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:41.563178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:41.564336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:41.571426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:41.571943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:41.572377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:41.573075 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:41.573528 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:41.573981 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:41.701815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:41.710019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:41.711595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:41.712759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fed27110-04e0-4e96-9ed7-a73d63faf3f7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.154745 Aug 25 03:29:41.713319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 446/905] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:41 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:42.069739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:42.070363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:42.077508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:42.077984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:42.078441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:42.079221 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:42.079669 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:42.080085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:42.209239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:42.216826 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1a257f64-4483-48a3-bf9e-030e370aabcc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.152574 Aug 25 03:29:42.217399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 460/906] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:42 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:42.737548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:42.738760 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:42.746221 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:42.746733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:42.747653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:42.748353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:42.748833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:42.749302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:42.892788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:42.901574 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:42.903122 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:42.904355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3d4d6468-ac4b-4e02-afd3-63f75bea7252 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.172242 Aug 25 03:29:42.904930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 447/907] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:42 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:42.948492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:42.950714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:42.956838 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:42.957314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:42.957742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:42.958461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:42.958910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:42.959329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:42.988813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-30822438-2d9b-4db4-9406-2759154ad5e6 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044324 Aug 25 03:29:42.989373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 461/908] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:42 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:43.088690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:43.089132 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:43.095158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.095641 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.096081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:43.096766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.097215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.097634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:43.126873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9957fe3e-fa73-439f-9b66-5f5fc04125ad tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/aa2566d4-077b-4820-a1c0-202d204e84e6" status: 200 len: 194 microversion: 2.1 time: 0.042165 Aug 25 03:29:43.127465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 448/909] 10.222.0.58 () {58 vars in 1413 bytes} [Thu Aug 25 03:29:43 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/aa2566d4-077b-4820-a1c0-202d204e84e6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:43.138019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:43.138602 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:43.145564 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.146105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.146616 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:43.147422 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.147941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.148369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:43.228645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lazy-loading 'services' on Instance uuid b6b8ac9b-add0-42b0-a55e-842e74995095 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:29:43.237424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:43.238042 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:43.244086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.244564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.244997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:43.245683 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.246204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.246742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:43.379439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:43.387125 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f24fc802-4f78-4e5a-952f-5b8bb22e905e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.153551 Aug 25 03:29:43.387743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 449/910] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:43 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:43.446058 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-250585a9-6b34-4246-9101-87c5f1ea3ef3 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/aa2566d4-077b-4820-a1c0-202d204e84e6" status: 202 len: 0 microversion: 2.1 time: 0.311706 Aug 25 03:29:43.446753 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 462/911] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:29:43 2022] DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/aa2566d4-077b-4820-a1c0-202d204e84e6 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:29:43.927277 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:43.927888 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:43.930188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:43.930935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:43.936653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.937134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.937570 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:43.938268 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:43.938747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:43.939172 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:44.075693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:44.084596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:44.086422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:44.087612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-67634bb3-fc2b-415d-8189-a87611e86753 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.164229 Aug 25 03:29:44.088181 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 450/912] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:43 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:44.405545 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:44.410876 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:44.411802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:44.419458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:44.420049 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:44.420486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:44.421192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:44.421801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:44.422302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:44.569158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:44.576945 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-86b01115-154a-467b-aea9-4d27c49f4cf0 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.172257 Aug 25 03:29:44.582159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 463/913] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:44 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:45.111207 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:45.111763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:45.118208 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.118714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.119148 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.120477 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.121317 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.121756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.258135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:45.266628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:45.268142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:45.269339 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-efa86cb7-b9de-4d46-be93-6989befd9ef4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1747 microversion: 2.20 time: 0.162764 Aug 25 03:29:45.269909 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 451/914] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:45 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:45.601213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:45.601973 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:45.609431 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.610163 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.610841 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.611706 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.612302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.612987 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.636542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:45.637033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:45.645699 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.649439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.649439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.649439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.649439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.649811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.683588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-59a04434-f0cb-4c91-a0fa-fafb024c34c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/66bd5472-0099-42c1-b6a1-6d18612166fc" status: 200 len: 194 microversion: 2.1 time: 0.050903 Aug 25 03:29:45.685338 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 452/915] 10.222.0.58 () {58 vars in 1413 bytes} [Thu Aug 25 03:29:45 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/66bd5472-0099-42c1-b6a1-6d18612166fc => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:45.696836 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:45.697448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:45.716612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.717101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.717534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.718319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:45.718786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:45.719214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:45.763501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:45.772419 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-83f5941c-30c0-4579-bf8f-1a95c390f445 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.175108 Aug 25 03:29:45.773002 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 464/916] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:45 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:45.804588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lazy-loading 'services' on Instance uuid b6b8ac9b-add0-42b0-a55e-842e74995095 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:29:45.965694 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-795d1430-91a8-46d3-89db-9e8fda780b81 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/66bd5472-0099-42c1-b6a1-6d18612166fc" status: 202 len: 0 microversion: 2.1 time: 0.274069 Aug 25 03:29:45.966308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 453/917] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:29:45 2022] DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments/66bd5472-0099-42c1-b6a1-6d18612166fc => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:29:46.293737 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:46.294970 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:46.301832 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:46.302356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:46.302926 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:46.303733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:46.304181 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:46.304595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:46.441273 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:46.451427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:46.453035 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:46.454223 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5283ff85-5591-4d8b-b631-8669758eb3dc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1747 microversion: 2.20 time: 0.165915 Aug 25 03:29:46.465412 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 465/918] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:46 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:46.685735 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-378a5636-9ffe-45c8-85f3-b2e4cf7475e1 req-582a1a06-866b-4037-9abb-64623e0e1d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454d5736-82fe-47b0-a508-0fb6bddd1a9c", "name": "network-vif-plugged", "status": "completed", "tag": "a9d9c369-cdd0-4501-a5a6-1f2bea0df716"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:46.695555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-378a5636-9ffe-45c8-85f3-b2e4cf7475e1 req-582a1a06-866b-4037-9abb-64623e0e1d01 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:46.696025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-378a5636-9ffe-45c8-85f3-b2e4cf7475e1 req-582a1a06-866b-4037-9abb-64623e0e1d01 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:46.696448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-378a5636-9ffe-45c8-85f3-b2e4cf7475e1 req-582a1a06-866b-4037-9abb-64623e0e1d01 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:46.718758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-378a5636-9ffe-45c8-85f3-b2e4cf7475e1 req-582a1a06-866b-4037-9abb-64623e0e1d01 service nova] Creating event network-vif-plugged:a9d9c369-cdd0-4501-a5a6-1f2bea0df716 for instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c on hv-cinder-85164 Aug 25 03:29:46.718758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-378a5636-9ffe-45c8-85f3-b2e4cf7475e1 req-582a1a06-866b-4037-9abb-64623e0e1d01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032012 Aug 25 03:29:46.718758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 454/919] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:46.797394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:46.798010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:46.807166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:46.807657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:46.808089 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:46.809029 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:46.809489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:46.811079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:46.961612 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:46.970013 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ddf0b75e-7a13-46bb-89c3-e203b80bbb03 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.180794 Aug 25 03:29:46.970765 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 466/920] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:46 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:47.481234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:47.482528 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:47.488559 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:47.489036 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:47.489461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:47.490139 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:47.490618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:47.491033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:47.624044 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:47.632160 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:47.633716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:47.634916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e28665d7-1f6e-4c5c-b7be-8de9ddd9b6bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1747 microversion: 2.20 time: 0.158057 Aug 25 03:29:47.635480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 455/921] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:47 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:29:47.991798 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:47.992353 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:47.998778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:47.999258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:47.999696 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.000377 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.000823 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.001244 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.156485 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:48.164512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fc6da66a-3665-4fdb-bda9-729c491b7b10 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.176546 Aug 25 03:29:48.165211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 467/922] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:47 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:48.204487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:48.206695 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:48.212953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.213459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.213888 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.214595 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.215040 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.215455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.243856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-04948fec-a2d0-47bd-9c8a-35feb29c14c4 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043796 Aug 25 03:29:48.244329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 456/923] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:48 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:29:48.353557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:48.355852 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:48.362257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.362768 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.363202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.363886 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.364340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.364761 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.393101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dadf8d22-57f8-45c8-9bab-71043a838465 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043447 Aug 25 03:29:48.393659 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 468/924] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:29:48 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:29:48.467218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:48.467709 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:48.473540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.474061 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.474534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.479276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.479276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.479276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.507935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:29:48.657083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:48.658420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:48.664514 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.665215 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.665715 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.666458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.666960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.667378 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.726473 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c021e47c-492e-4bdd-bab4-a9009a2a8eba tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 204 len: 0 microversion: 2.1 time: 0.263685 Aug 25 03:29:48.727386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 457/925] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:29:48 2022] DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:29:48.736112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:48.737074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:48.743202 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.743811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.744455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.745251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:48.745810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:48.747629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:48.832184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:48.840345 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:48.842025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:48.843287 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-feead684-1deb-41ea-b3aa-cb0112403dbe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1747 microversion: 2.20 time: 0.190101 Aug 25 03:29:48.843991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 469/926] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:48 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1747 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:29:48.894140 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:48.902644 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-678a4679-fc18-4fdc-b2f8-03b46a9a0b47 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1674 microversion: 2.1 time: 0.171064 Aug 25 03:29:48.903225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 458/927] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:48 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:49.186384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:49.186989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:49.193304 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:49.193778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:49.194207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:49.194910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:49.195357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:49.195774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:49.325835 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:49.333366 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b562ad92-f062-432e-9797-6d58a311941b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.151648 Aug 25 03:29:49.333958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 470/928] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:49 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:49.866067 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:49.866738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:49.874194 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:49.874700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:49.875134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:49.875821 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:49.876335 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:49.876757 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:49.924074 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:49.924691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:49.931034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:49.931515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:49.931943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:49.932628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:49.933076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:49.933525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:50.051908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:50.061106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:50.062637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:50.063801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-994be3bc-a00f-44c9-9316-187e6977637d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1747 microversion: 2.20 time: 0.201658 Aug 25 03:29:50.064370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 459/929] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:49 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1747 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:50.095461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:50.103622 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9f84bcee-8d9d-4aeb-9793-ae5bf634b705 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1674 microversion: 2.1 time: 0.183443 Aug 25 03:29:50.112326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 471/930] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:49 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:50.354937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:50.355475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:50.361927 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:50.362425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:50.362847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:50.363517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:50.363957 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:50.364369 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:50.368365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:50.492059 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:50.500367 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-926471a3-d7cf-4f3b-8ddd-46b7bb9e4e2e tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1367 microversion: 2.1 time: 0.149323 Aug 25 03:29:50.500953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 460/931] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:50 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:50.602033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-748b5ba3-739b-4811-bdb8-ca80bf9e9a16 req-bee2172a-1aa7-43de-94bf-63fe0b3e81b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13340cf-6d9d-48f1-9b26-78bd805f1aed", "name": "network-vif-plugged", "status": "completed", "tag": "4efa8180-10d5-4eb6-a73b-338c8f8a08e9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:50.612511 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-748b5ba3-739b-4811-bdb8-ca80bf9e9a16 req-bee2172a-1aa7-43de-94bf-63fe0b3e81b5 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:50.613018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-748b5ba3-739b-4811-bdb8-ca80bf9e9a16 req-bee2172a-1aa7-43de-94bf-63fe0b3e81b5 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:50.613451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-748b5ba3-739b-4811-bdb8-ca80bf9e9a16 req-bee2172a-1aa7-43de-94bf-63fe0b3e81b5 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:50.625241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-748b5ba3-739b-4811-bdb8-ca80bf9e9a16 req-bee2172a-1aa7-43de-94bf-63fe0b3e81b5 service nova] Creating event network-vif-plugged:4efa8180-10d5-4eb6-a73b-338c8f8a08e9 for instance e13340cf-6d9d-48f1-9b26-78bd805f1aed on hv-cinder-85164 Aug 25 03:29:50.630140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-748b5ba3-739b-4811-bdb8-ca80bf9e9a16 req-bee2172a-1aa7-43de-94bf-63fe0b3e81b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031769 Aug 25 03:29:50.630846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 472/932] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:51.087538 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:51.088173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:51.094676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.095157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.095593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.096276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.096726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.097150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.135075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:51.135864 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:51.142432 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.142910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.143338 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.144056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.144504 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.144919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.282074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:51.290419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:51.291915 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:51.293119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-67b1fcc8-846f-4b28-a0dc-bf7b7ed933fd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1747 microversion: 2.20 time: 0.209516 Aug 25 03:29:51.294223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 461/933] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:51 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1747 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:51.304959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:51.314119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1e7a5f5e-a082-4aac-a99f-66227b97c5f5 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1674 microversion: 2.1 time: 0.183437 Aug 25 03:29:51.314713 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 473/934] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:51 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:29:51.520461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:51.521060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:51.526963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.527435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.527869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.528555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.529014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.529457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.660796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:51.668548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c896768c-5be2-4100-8f61-0261446c176f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1557 microversion: 2.1 time: 0.152044 Aug 25 03:29:51.669164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 462/935] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:51 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:51.689785 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:51.690497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:51.696707 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.697193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.697623 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.698339 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:51.698794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:51.699213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:51.784263 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6c576556-9f28-4a7c-94ba-41af81fb2709 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098420 Aug 25 03:29:51.784874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 474/936] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 25 03:29:51 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:52.315806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:52.316414 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:52.322856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:52.323651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:52.324077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:52.324763 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:52.325212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:52.325620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:52.335025 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:52.335625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:52.350627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:52.351111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:52.351632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:52.352373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:52.352763 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:52.353184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:52.674391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:52.686099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:52.688798 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:52.690036 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:52.691365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2dd122e8-1d65-4c94-abc8-c7bac1b6274a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.379567 Aug 25 03:29:52.697415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 463/937] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:52 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:52.714625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ff269a2f-51e1-4954-98d0-b20350bd6c49 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1674 microversion: 2.1 time: 0.372385 Aug 25 03:29:52.714625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 475/938] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:52 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1674 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:52.973688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-16f2bf91-1457-452e-a67e-d0387f9e732a req-55d58b43-354b-4b4b-91eb-11977bfeef0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b8ac9b-add0-42b0-a55e-842e74995095", "name": "network-vif-deleted", "tag": "9c839108-8a6d-4e0d-82a1-3d11e580aa98"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:52.985350 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-16f2bf91-1457-452e-a67e-d0387f9e732a req-55d58b43-354b-4b4b-91eb-11977bfeef0a service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:52.985820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-16f2bf91-1457-452e-a67e-d0387f9e732a req-55d58b43-354b-4b4b-91eb-11977bfeef0a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:52.986470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-16f2bf91-1457-452e-a67e-d0387f9e732a req-55d58b43-354b-4b4b-91eb-11977bfeef0a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:53.000121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-16f2bf91-1457-452e-a67e-d0387f9e732a req-55d58b43-354b-4b4b-91eb-11977bfeef0a service nova] Creating event network-vif-deleted:9c839108-8a6d-4e0d-82a1-3d11e580aa98 for instance b6b8ac9b-add0-42b0-a55e-842e74995095 on hv-cinder-85164 Aug 25 03:29:53.005219 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-16f2bf91-1457-452e-a67e-d0387f9e732a req-55d58b43-354b-4b4b-91eb-11977bfeef0a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035240 Aug 25 03:29:53.011723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 464/939] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:29:53.139392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-aaa47b6c-0308-49e5-8677-c89a1a257374 req-3b6dba2e-4a96-40c7-99b3-910e0e1a2252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454d5736-82fe-47b0-a508-0fb6bddd1a9c", "tag": "a9d9c369-cdd0-4501-a5a6-1f2bea0df716"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:29:53.176781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-aaa47b6c-0308-49e5-8677-c89a1a257374 req-3b6dba2e-4a96-40c7-99b3-910e0e1a2252 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:53.177442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-aaa47b6c-0308-49e5-8677-c89a1a257374 req-3b6dba2e-4a96-40c7-99b3-910e0e1a2252 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:53.177885 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-aaa47b6c-0308-49e5-8677-c89a1a257374 req-3b6dba2e-4a96-40c7-99b3-910e0e1a2252 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:53.221376 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-aaa47b6c-0308-49e5-8677-c89a1a257374 req-3b6dba2e-4a96-40c7-99b3-910e0e1a2252 service nova] Creating event network-changed:a9d9c369-cdd0-4501-a5a6-1f2bea0df716 for instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c on hv-cinder-85164 Aug 25 03:29:53.237349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-aaa47b6c-0308-49e5-8677-c89a1a257374 req-3b6dba2e-4a96-40c7-99b3-910e0e1a2252 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186971 Aug 25 03:29:53.240621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 476/940] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:29:53.737117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:53.738022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:53.738456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:53.738948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:53.757957 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:53.759323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:53.759754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:53.760654 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:53.761114 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:53.762583 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:53.764389 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:53.770687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:53.773227 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:53.774101 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:53.780084 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:53.781112 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:53.821899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:29:53.835486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:53.836355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:53.837051 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:53.837728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lazy-loading 'fault' on Instance uuid b6b8ac9b-add0-42b0-a55e-842e74995095 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:29:54.022077 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e90afadb164c82bc93c47099c14460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6240beed94fc38a7f1b85c7fad39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:54.035553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b3b749a0-1955-4af2-99ce-ec205a8a0eaf tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 200 len: 1328 microversion: 2.1 time: 0.297058 Aug 25 03:29:54.038626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 477/941] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:53 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 1328 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:29:54.159956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:54.174923 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:54.181108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:54.181886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fb09be57-1e56-431f-8f19-9b096a4277d6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.448961 Aug 25 03:29:54.185420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 465/942] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:53 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:55.063288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:55.063903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:55.070665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:55.071149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:55.071585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:55.072267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:55.072906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:55.073495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:55.091962 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] HTTP exception thrown: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Request method failure captured: Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 HTTP/1.1 Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuomQY7oXJwhOW09tgSssDaHsuPkcTcuHD_n86IShE52SCIYJ9qj1P10okFi_R1tbeBKWThrXBn0ZfJaJ522qlZ2F19GF8CbPyYmBDxOgpbT6XURodNEw1ofa0rumFMRr-l9ncfl6MJd4Ekr8xQjozhM_KIpzPgPx8_wKBRZ21ddJN0 Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:29:55.093974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6240beed94fc38a7f1b85c7fad39c"}]}] Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 83e90afadb164c82bc93c47099c14460 Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:55.095816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'b6b8ac9b-add0-42b0-a55e-842e74995095'} Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:29:55.096646 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:55.097948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:55.101355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Returning 404 to user: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:29:55.101355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-36857537-76ec-4d6c-a6f1-6039716742af tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 404 len: 111 microversion: 2.1 time: 0.038057 Aug 25 03:29:55.101355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 478/943] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:55 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:29:55.105609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d89bf5cf-d5ce-4a32-94d4-861966747417 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '.version_select at 0x7fa33a53b1f0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:55.209540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:55.210256 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:55.217396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:55.218262 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:55.218907 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:55.219777 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:55.220396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:55.220812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:55.225865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d89bf5cf-d5ce-4a32-94d4-861966747417 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710597728" status: 202 len: 0 microversion: 2.1 time: 0.125078 Aug 25 03:29:55.232354 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 466/944] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Aug 25 03:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710597728 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:29:55.372354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:55.382859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:55.384819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:55.386234 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b4111cea-6b4a-4b6c-90fc-ae70001dbe8e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.180812 Aug 25 03:29:55.387654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 479/945] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:55 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:29:56.410665 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:56.411262 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:56.417979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:56.418522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:56.419495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:56.420185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:56.420636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:56.421062 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:56.581874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:56.591087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:56.592844 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:56.594321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3b919ba5-f78a-40ab-ba59-e00822241b1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.188152 Aug 25 03:29:56.595036 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 467/946] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:56 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:57.625920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:57.626977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:57.639997 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:57.640559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:57.641069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:57.641844 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:57.646061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:57.651756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:57.785604 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:57.793854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:57.796272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:57.798052 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-694bd4eb-09d4-49c6-8303-4f30a7a47b29 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.183237 Aug 25 03:29:57.806318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 480/947] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:57 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:29:58.615701 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:58.616208 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:58.623404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:58.623928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:58.624362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:58.625052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:58.625503 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:58.625926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:58.644116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] HTTP exception thrown: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Request method failure captured: Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 HTTP/1.1 Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuomQY7oXJwhOW09tgSssDaHsuPkcTcuHD_n86IShE52SCIYJ9qj1P10okFi_R1tbeBKWThrXBn0ZfJaJ522qlZ2F19GF8CbPyYmBDxOgpbT6XURodNEw1ofa0rumFMRr-l9ncfl6MJd4Ekr8xQjozhM_KIpzPgPx8_wKBRZ21ddJN0 Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:29:58.645791 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6240beed94fc38a7f1b85c7fad39c"}]}] Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 83e90afadb164c82bc93c47099c14460 Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.647482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'b6b8ac9b-add0-42b0-a55e-842e74995095'} Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:29:58.648392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.649860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.651259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Returning 404 to user: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:29:58.651259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e71713d0-2f4c-4fd1-a656-b5cb1ea13929 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 404 len: 111 microversion: 2.1 time: 0.035361 Aug 25 03:29:58.651259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 468/948] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:29:58 2022] DELETE /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:29:58.658052 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:58.658913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: b6b8ac9b-add0-42b0-a55e-842e74995095] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:58.666620 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:58.667104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:58.667542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:58.668279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:58.668965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:58.669390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:58.685442 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] HTTP exception thrown: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Request method failure captured: Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 HTTP/1.1 Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuomQY7oXJwhOW09tgSssDaHsuPkcTcuHD_n86IShE52SCIYJ9qj1P10okFi_R1tbeBKWThrXBn0ZfJaJ522qlZ2F19GF8CbPyYmBDxOgpbT6XURodNEw1ofa0rumFMRr-l9ncfl6MJd4Ekr8xQjozhM_KIpzPgPx8_wKBRZ21ddJN0 Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:29:58.687648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6240beed94fc38a7f1b85c7fad39c"}]}] Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 83e90afadb164c82bc93c47099c14460 Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.689006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'b6b8ac9b-add0-42b0-a55e-842e74995095'} Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:29:58.689795 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. Aug 25 03:29:58.691634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:29:58.693183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Returning 404 to user: Instance b6b8ac9b-add0-42b0-a55e-842e74995095 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:29:58.693183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e423bc5f-6075-485b-a5cc-58325d468a3c tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095" status: 404 len: 111 microversion: 2.1 time: 0.036921 Aug 25 03:29:58.695519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 481/949] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:29:58 2022] GET /compute/v2.1/servers/b6b8ac9b-add0-42b0-a55e-842e74995095 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:29:58.825079 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:58.825874 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:58.832070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:58.832549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:58.832982 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:58.833678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:58.834153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:58.834585 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:59.002057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:59.012688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:59.014726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:29:59.018471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b3b2ee49-2afc-46ea-a6ff-d7c4d55c9375 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.197427 Aug 25 03:29:59.019232 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 469/950] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:29:58 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:29:59.983718 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:29:59.984224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:29:59.991124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:59.991641 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:59.992144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:29:59.992959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:29:59.993451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:29:59.993874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:00.007544 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] HTTP exception thrown: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Request method failure captured: Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 HTTP/1.1 Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuomQY7oXJwhOW09tgSssDaHsuPkcTcuHD_n86IShE52SCIYJ9qj1P10okFi_R1tbeBKWThrXBn0ZfJaJ522qlZ2F19GF8CbPyYmBDxOgpbT6XURodNEw1ofa0rumFMRr-l9ncfl6MJd4Ekr8xQjozhM_KIpzPgPx8_wKBRZ21ddJN0 Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:30:00.009067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6240beed94fc38a7f1b85c7fad39c"}]}] Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 83e90afadb164c82bc93c47099c14460 Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.011226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89'} Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:30:00.012342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.014533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.016063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Returning 404 to user: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:30:00.016063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b8b482ac-de4b-4b69-ab07-ebde54a5060f tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 404 len: 111 microversion: 2.1 time: 0.031389 Aug 25 03:30:00.016063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 482/951] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:29:59 2022] DELETE /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:30:00.019983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:00.020639 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] [instance: a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:00.027453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:00.027935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:00.028373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:00.029717 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:00.030344 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:00.030776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:00.042605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:00.043298 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:00.048362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] HTTP exception thrown: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Request method failure captured: Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 HTTP/1.1 Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuomQY7oXJwhOW09tgSssDaHsuPkcTcuHD_n86IShE52SCIYJ9qj1P10okFi_R1tbeBKWThrXBn0ZfJaJ522qlZ2F19GF8CbPyYmBDxOgpbT6XURodNEw1ofa0rumFMRr-l9ncfl6MJd4Ekr8xQjozhM_KIpzPgPx8_wKBRZ21ddJN0 Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:30:00.050135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6240beed94fc38a7f1b85c7fad39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6240beed94fc38a7f1b85c7fad39c"}]}] Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: d8e6240beed94fc38a7f1b85c7fad39c Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2107513787 Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 83e90afadb164c82bc93c47099c14460 Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeTestJSON-2107513787-project Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.051759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89'} Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:30:00.056169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. Aug 25 03:30:00.057530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:30:00.059240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:00.059240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:00.059439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] Returning 404 to user: Instance a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:30:00.059547 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:00.059641 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-02bdafde-0fdf-4007-9550-2e4431455129 tempest-AttachVolumeTestJSON-2107513787 tempest-AttachVolumeTestJSON-2107513787-project] 10.222.0.58 "GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89" status: 404 len: 111 microversion: 2.1 time: 0.036086 Aug 25 03:30:00.059743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:00.059743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:00.060204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 470/952] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:00 2022] GET /compute/v2.1/servers/a60c4e7f-33a2-4cd8-b6c4-8c5ffad61c89 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:30:00.060310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:00.199608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:00.208819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:00.210441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:00.211697 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-192df9d9-61ab-47b5-8e7d-b3bb3b184b41 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.173095 Aug 25 03:30:00.212274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 483/953] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:00 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:30:01.236195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:01.237518 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:01.245078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:01.245994 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:01.246698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:01.247622 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:01.248877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:01.249507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:01.460269 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:01.470656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:01.479407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:01.479407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1544a5e6-c323-436e-9078-7b93c9a138e8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.241794 Aug 25 03:30:01.479407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 471/954] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:01 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:02.500265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:02.502138 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:02.513699 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:02.514487 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:02.515080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:02.516677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:02.516677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:02.517386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:02.958933 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:02.970204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:02.972222 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:02.973816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1b7f7b21-9951-47c4-b148-820c11a91189 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.478959 Aug 25 03:30:02.974434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 484/955] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:02 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:04.012905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:04.012905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:04.017324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:04.017820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:04.018255 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:04.018990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:04.019654 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:04.020086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:04.240704 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:04.253589 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:04.257156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:04.259853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0059a002-dde2-462c-9774-f417569c78ef tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.266737 Aug 25 03:30:04.260986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 472/956] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:03 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:05.284902 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:05.285643 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:05.293083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:05.293564 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:05.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:05.294950 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:05.295468 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:05.296005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:05.485087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:05.493379 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:05.495068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:05.496237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fad43141-2c31-4b56-84a6-69ce67e410ed tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1742 microversion: 2.20 time: 0.215627 Aug 25 03:30:05.496801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 485/957] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:05 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:06.518772 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:06.519386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:06.525928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:06.526449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:06.526885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:06.527574 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:06.528023 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:06.528443 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:06.661715 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:06.671048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:06.672776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:06.673998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b92a1c2c-b51b-4008-9233-782d712fd6ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1724 microversion: 2.20 time: 0.159037 Aug 25 03:30:06.674590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 473/958] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:06 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:06.821757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cbcfc964-69e7-4449-b1bc-220bbcdbcac6 tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Action: 'create', calling method: .version_select at 0x7fa33df44280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-488296918", "metadata": {"Type": "work"}}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:07.527528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cbcfc964-69e7-4449-b1bc-220bbcdbcac6 tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.818682 Aug 25 03:30:07.528177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 486/959] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Aug 25 03:30:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 820 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 03:30:07.540628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ea77d1a2-60e6-4c28-9de3-2deecb523db8 tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Calling method '.version_select at 0x7fa33a6be1f0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:07.589974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ea77d1a2-60e6-4c28-9de3-2deecb523db8 tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374" status: 200 len: 352 microversion: 2.1 time: 0.052947 Aug 25 03:30:07.593730 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 474/960] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:30:07 2022] GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:30:07.698107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:07.698779 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:07.702648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=72 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:07.706394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:07.706877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:07.707314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:07.708002 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:07.708545 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:07.708978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:07.838355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:07.847202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:07.848806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:07.849987 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c2f3605c-9438-49f7-a88d-1930c53387db tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1724 microversion: 2.20 time: 0.156878 Aug 25 03:30:07.850571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 487/961] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:07 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:08.604416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1efc0476-f615-4945-8e25-cf4e31f666da tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Calling method '.version_select at 0x7fa33a564310>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:08.653222 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1efc0476-f615-4945-8e25-cf4e31f666da tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374" status: 200 len: 353 microversion: 2.1 time: 0.053234 Aug 25 03:30:08.653877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 475/962] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:30:08 2022] GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:30:08.673336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-64463687-3ecd-4051-9d12-9dc9800902fe tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Calling method '.version_select at 0x7fa33a5649d0>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:08.696113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-bb2513fa-3d34-45d1-aae8-6dbbcd905512 req-dcb63b95-5028-4385-9c64-1cd248da7773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13340cf-6d9d-48f1-9b26-78bd805f1aed", "name": "network-vif-unplugged", "status": "completed", "tag": "4efa8180-10d5-4eb6-a73b-338c8f8a08e9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:08.705994 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bb2513fa-3d34-45d1-aae8-6dbbcd905512 req-dcb63b95-5028-4385-9c64-1cd248da7773 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:08.706513 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bb2513fa-3d34-45d1-aae8-6dbbcd905512 req-dcb63b95-5028-4385-9c64-1cd248da7773 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:08.706934 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bb2513fa-3d34-45d1-aae8-6dbbcd905512 req-dcb63b95-5028-4385-9c64-1cd248da7773 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:08.718322 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-bb2513fa-3d34-45d1-aae8-6dbbcd905512 req-dcb63b95-5028-4385-9c64-1cd248da7773 service nova] Creating event network-vif-unplugged:4efa8180-10d5-4eb6-a73b-338c8f8a08e9 for instance e13340cf-6d9d-48f1-9b26-78bd805f1aed on hv-cinder-85164 Aug 25 03:30:08.723439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-bb2513fa-3d34-45d1-aae8-6dbbcd905512 req-dcb63b95-5028-4385-9c64-1cd248da7773 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087544 Aug 25 03:30:08.723956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-64463687-3ecd-4051-9d12-9dc9800902fe tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374" status: 200 len: 353 microversion: 2.1 time: 0.054356 Aug 25 03:30:08.724140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 488/963] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:30:08.724560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 476/964] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:30:08 2022] GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:30:08.742065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-887b2d30-d930-4349-8868-5ef6691cef28 tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Calling method '.version_select at 0x7fa33dfce940>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:08.873147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:08.873756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:08.879797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:08.880279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:08.880713 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:08.881405 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:08.881854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:08.882293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:08.920849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-887b2d30-d930-4349-8868-5ef6691cef28 tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374" status: 202 len: 0 microversion: 2.1 time: 0.182678 Aug 25 03:30:08.921436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 489/965] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:30:08 2022] DELETE /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:30:08.929657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0de84868-e538-42f5-af10-4e97f715146f tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Calling method '.version_select at 0x7fa33e0061f0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:08.977225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0de84868-e538-42f5-af10-4e97f715146f tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374" status: 200 len: 352 microversion: 2.1 time: 0.051830 Aug 25 03:30:08.977941 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 490/966] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:30:08 2022] GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:30:09.016742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:09.024843 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:09.026382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:09.027542 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f6a82ee7-78a7-4eb6-8930-1f74c4e80df6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1724 microversion: 2.20 time: 0.158453 Aug 25 03:30:09.028104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 477/967] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:08 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:30:09.991456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f5fb547d-794e-478a-a44d-224da3354e2c tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Calling method '.version_select at 0x7fa33a57d280>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:10.019883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-f5fb547d-794e-478a-a44d-224da3354e2c tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] HTTP exception thrown: Volume cf030ed1-0877-43a5-a1f0-d1eeee2ee374 could not be found. Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f5fb547d-794e-478a-a44d-224da3354e2c tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Request method failure captured: Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374 HTTP/1.1 Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuy-lQcbePL39YkNttes05IVBUyXByZEc5Z0lnFl4otFYs64Lj7Erf3nlB80OPMGVM09MGzeXmyIInOAUEPi-7mV5JixLqotJ9ErnYHCkjLnRxRwr8H1cHpiox2fxAmYclJ-qNms4SpVhOoaidUFDIMaryncF8BXKcjkDha-dklAF_k Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: d0067a677f744be08ca3a14794e688ea Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesGetTestJSON-392792645 Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:30:10.021966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0067a677f744be08ca3a14794e688ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d0067a677f744be08ca3a14794e688ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d0067a677f744be08ca3a14794e688ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d0067a677f744be08ca3a14794e688ea"}]}] Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesGetTestJSON-392792645 Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d0067a677f744be08ca3a14794e688ea Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesGetTestJSON-392792645 Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesGetTestJSON-392792645-project Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 95057bde266143a8923bcf0f9a3f81e8 Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesGetTestJSON-392792645-project Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Volume cf030ed1-0877-43a5-a1f0-d1eeee2ee374 could not be found. Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'cf030ed1-0877-43a5-a1f0-d1eeee2ee374'} Aug 25 03:30:10.023712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf030ed1-0877-43a5-a1f0-d1eeee2ee374 could not be found. (HTTP 404) (Request-ID: req-c9ea6bf3-276c-4bbe-a055-32eec306ab0a) Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:30:10.024775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:30:10.026259 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf030ed1-0877-43a5-a1f0-d1eeee2ee374 could not be found. Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:30:10.028069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf030ed1-0877-43a5-a1f0-d1eeee2ee374 could not be found. Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf030ed1-0877-43a5-a1f0-d1eeee2ee374 could not be found. Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f5fb547d-794e-478a-a44d-224da3354e2c tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] Returning 404 to user: Volume cf030ed1-0877-43a5-a1f0-d1eeee2ee374 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f5fb547d-794e-478a-a44d-224da3354e2c tempest-VolumesGetTestJSON-392792645 tempest-VolumesGetTestJSON-392792645-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374" status: 404 len: 109 microversion: 2.1 time: 0.036332 Aug 25 03:30:10.029647 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 491/968] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Aug 25 03:30:09 2022] GET /compute/v2.1/os-volumes/cf030ed1-0877-43a5-a1f0-d1eeee2ee374 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:30:10.051812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:10.052483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:10.059002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:10.059471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:10.060774 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:10.061506 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:10.061950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:10.062395 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:10.205720 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:10.214818 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:10.216870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:10.218309 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6ecd557b-80c5-49ba-ba9c-b0751f14884a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1727 microversion: 2.20 time: 0.170552 Aug 25 03:30:10.218978 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 478/969] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:10 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:10.242972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5675628f-8952-4721-af83-ac6e8d758e3f"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:10.246448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:10.253897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:10.261113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:10.261113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:10.261113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:10.261113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:10.261501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:11.165428 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a36b89b8-dcfe-4d30-aeea-94bd2fb96f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.927718 Aug 25 03:30:11.171490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 492/970] 10.222.0.58 () {62 vars in 1364 bytes} [Thu Aug 25 03:30:10 2022] POST /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments => generated 188 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:30:11.289517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:11.290112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:11.293177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:11.298579 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:11.299001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:11.303450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:11.303450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:11.303450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:11.303450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:11.595837 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121278) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 03:30:11.819857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7cc0f7d6-8396-4ca3-bcd6-6f0ceb96616e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/action" status: 202 len: 0 microversion: 2.20 time: 0.534497 Aug 25 03:30:11.825443 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 479/971] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Aug 25 03:30:11 2022] POST /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:30:11.832748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:11.833360 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:11.840723 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:11.842421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:11.843290 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:11.844145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:11.844592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:11.845008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:11.988623 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:11.998869 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:12.000605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:12.001967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5877a6ee-70d6-4681-b4e5-9505f3fb0d97 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1753 microversion: 2.20 time: 0.173584 Aug 25 03:30:12.002742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 493/972] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:11 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:13.026521 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:13.028227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:13.034985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:13.036060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:13.036193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:13.036903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:13.037365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:13.037890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:13.188111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:13.196835 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:13.198391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:13.199599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b4f751de-01c1-41d2-b2d1-913c6a348079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1753 microversion: 2.20 time: 0.177792 Aug 25 03:30:13.200144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 480/973] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:13 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:14.224333 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:14.224877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:14.231321 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:14.231847 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:14.232330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:14.233015 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:14.233467 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:14.233891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:14.366634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:14.377140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:14.378697 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:14.380120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0d783308-a4e6-48f2-bb88-9b4fcfb334eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1755 microversion: 2.20 time: 0.159584 Aug 25 03:30:14.380881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 494/974] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:14 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:15.402926 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:15.404413 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:15.410626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:15.411176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:15.411767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:15.412676 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:15.413121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:15.413545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:15.550527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:15.553860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:15.561714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:15.561879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:15.564032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a6fd614b-e463-4e49-af91-9ad7baa6068d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.165366 Aug 25 03:30:15.565086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 481/975] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:15 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:30:16.586931 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:16.587560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:16.595048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:16.595499 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:16.595965 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:16.596660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:16.597114 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:16.597697 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:16.738435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:16.747367 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:16.749119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:16.750552 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8008e523-6b1f-4cb4-b915-c9dd101abcc5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.167503 Aug 25 03:30:16.751109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 495/976] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:16 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:17.775210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:17.776013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:17.784153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:17.784678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:17.785138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:17.785846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:17.786323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:17.786756 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:17.928063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:17.942430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:17.944265 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:17.945463 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cd8d0861-8dac-435d-a572-000b1c1298da tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.174897 Aug 25 03:30:17.946033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 482/977] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:17 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:18.968940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:18.969542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:18.976551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:18.977024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:18.977456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:18.978136 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:18.978617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:18.979064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:19.116578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:19.125829 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:19.127380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:19.128518 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-65a01e23-9ffe-46ab-b26f-75e9eda324b2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.163524 Aug 25 03:30:19.129075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 496/978] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:18 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:20.151346 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:20.151950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:20.164890 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:20.165459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:20.165814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:20.166553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:20.167003 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:20.167427 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:20.297517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:20.306076 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:20.307608 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:20.308785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5b57d6e2-90a5-4ed7-b372-a900902a7b57 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.161421 Aug 25 03:30:20.309336 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 483/979] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:20 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:21.332607 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:21.333785 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:21.341614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:21.343222 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:21.352010 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:21.353016 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:21.353565 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:21.354070 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:21.488951 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:21.492457 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:21.497828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:21.499906 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:21.501066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b6146168-3aac-4489-b071-554e752c4957 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.172497 Aug 25 03:30:21.501627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 497/980] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:21 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:22.524928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:22.526173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:22.534594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:22.535071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:22.535505 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:22.536188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:22.536632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:22.537080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:22.675417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:22.685004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:22.686554 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:22.687771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-49685a1e-09dd-4b0a-a60a-d176eda38852 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.166717 Aug 25 03:30:22.688360 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 484/981] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:22 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:23.711213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:23.711825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:23.719358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:23.719893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:23.720752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:23.721005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:23.721506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:23.721873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:23.851895 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:23.861038 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:23.862573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:23.863760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-860bd760-dff4-4de8-a695-b6bf27fddf9d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.156412 Aug 25 03:30:23.864315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 498/982] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:23 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:24.886392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:24.886946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:24.893308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:24.893786 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:24.894217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:24.894920 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:24.895367 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:24.895785 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:25.030545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:25.039146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:25.040656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:25.041816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-62afa0d5-f7a3-4d8f-9510-6e18d7871ef1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.159432 Aug 25 03:30:25.042396 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 485/983] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:24 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:26.067075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:26.067850 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:26.084157 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:26.084667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:26.085362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:26.085806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:26.086261 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:26.086797 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:26.244982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:26.255850 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:26.257342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:26.258540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-772e12db-8fb5-4f4d-afed-dcb868a13a0a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.195697 Aug 25 03:30:26.259102 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 499/984] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:26 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:27.281107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:27.281781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:27.288456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:27.288935 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:27.289369 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:27.290059 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:27.290543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:27.290970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:27.429936 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:27.440416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:27.442442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:27.443999 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5f617166-7872-41a6-96d0-eb317022879a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.166862 Aug 25 03:30:27.445226 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 486/985] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:27 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:28.471927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:28.472628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:28.479896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:28.480449 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:28.480890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:28.482898 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:28.483475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:28.484529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:28.629614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:28.641591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:28.647899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:28.647899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0781db44-7e9b-4789-9152-cda9e380a130 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.177007 Aug 25 03:30:28.647899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 500/986] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:28 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:29.667925 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:29.668621 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:29.675934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:29.679638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:29.679638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:29.679638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:29.679638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:29.680069 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:29.834416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:29.845487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:29.847124 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:29.848365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-11eee86c-2230-4050-8803-c403eed2cc24 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.184540 Aug 25 03:30:29.849306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 487/987] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:29 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:30.877598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:30.878209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:30.888021 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:30.888757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:30.889189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:30.889887 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:30.890515 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:30.891427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:31.089417 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:31.090543 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:31.092084 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:31.094119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ba746ded-3e5f-4603-befb-ff97d8ec55f8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.220454 Aug 25 03:30:31.094884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 501/988] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:30 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:32.118733 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:32.119509 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:32.126466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:32.127020 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:32.127534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:32.128310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:32.128872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:32.129531 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:32.267122 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:32.277123 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:32.278683 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:32.279861 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-643b2364-4a73-412b-b2da-d1790f9e35a0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.165285 Aug 25 03:30:32.280461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 488/989] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:32 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:30:33.309893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:33.310666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:33.318343 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:33.318862 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:33.319420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:33.320208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:33.320653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:33.321076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:33.467227 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:33.482369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:33.484270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:33.486475 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3737af7a-ccd1-4efb-b69d-2dd6c17c0411 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.182075 Aug 25 03:30:33.487153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 502/990] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:33 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:34.522484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:34.523621 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:34.533482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:34.538617 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:34.538617 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:34.538617 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:34.538617 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:34.539205 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:34.713102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:34.724710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:34.726331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:34.727507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2693f660-b9ca-410c-a7eb-9786155bf18e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.210371 Aug 25 03:30:34.728393 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 489/991] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:34 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:35.751510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:35.752249 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:35.759882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:35.760370 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:35.760806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:35.761503 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:35.761952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:35.762476 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:35.897464 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:35.908253 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:35.909911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:35.911425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cb155815-0497-4fff-aefb-be788d99782f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.164525 Aug 25 03:30:35.924147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 503/992] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:35 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:36.935157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:36.935863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:36.943013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:36.943673 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:36.944107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:36.944808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:36.945259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:36.945679 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:37.093422 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:37.105375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:37.116011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:37.116011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b2d0fa8b-7bfd-47c0-bd8c-ce3f9dbdb332 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.177169 Aug 25 03:30:37.116011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 490/993] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:36 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:38.133778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:38.135113 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:38.137438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=28 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:38.143827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:38.144645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:38.145150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:38.146106 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:38.146588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:38.147144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:38.294450 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:38.303931 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:38.305393 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:38.306608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8230d309-3908-49f9-9bd1-6979ec704b37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.176813 Aug 25 03:30:38.307161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 504/994] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:38 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:30:39.331126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:39.331752 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:39.338450 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:39.338937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:39.339373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:39.340054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:39.340504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:39.340993 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:39.480326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:39.489517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:39.491398 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:39.492934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-80034aca-ff2f-438e-a304-436fc8c6e5a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.166507 Aug 25 03:30:39.493857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 491/995] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:39 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:40.516140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:40.516749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:40.522611 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:40.523093 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:40.523527 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:40.524217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:40.524671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:40.525093 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:40.655493 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:40.664270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:40.665838 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:40.667043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-79f9c174-6fad-42c5-ad5c-872e380cd6d0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.154687 Aug 25 03:30:40.667597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 505/996] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:40 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:41.691460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:41.692173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:41.694571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:41.699371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:41.700099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:41.700530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:41.701218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:41.701659 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:41.702072 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:41.871404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:41.882231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:41.883806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:41.885012 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a8cdb723-0200-48d6-a268-39e05372e046 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.198014 Aug 25 03:30:41.885574 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 492/997] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:41 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:42.910135 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:42.910775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:42.923182 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:42.923663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:42.924091 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:42.926871 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:42.927456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:42.930088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:43.073478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:43.084116 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:43.085635 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:43.086856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7fe76b49-01fc-4fc6-850d-e5d9394ac0e5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.181772 Aug 25 03:30:43.087559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 506/998] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:42 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:44.109123 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:44.109678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:44.116501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:44.117029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:44.117465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:44.118156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:44.118640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:44.119063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:44.244656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:44.253371 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:44.254920 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:44.256081 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ef39f036-05b1-4ea5-aff0-4208d7d2f172 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.150985 Aug 25 03:30:44.256644 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 493/999] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:44 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:44.852087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-e6bb5659-1dfa-49e1-a070-a9115e561ed7 req-c55c93d2-2366-4d50-9355-5952a9141102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13340cf-6d9d-48f1-9b26-78bd805f1aed", "name": "network-vif-plugged", "status": "completed", "tag": "4efa8180-10d5-4eb6-a73b-338c8f8a08e9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:44.862111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e6bb5659-1dfa-49e1-a070-a9115e561ed7 req-c55c93d2-2366-4d50-9355-5952a9141102 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:44.862622 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e6bb5659-1dfa-49e1-a070-a9115e561ed7 req-c55c93d2-2366-4d50-9355-5952a9141102 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:44.863081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-e6bb5659-1dfa-49e1-a070-a9115e561ed7 req-c55c93d2-2366-4d50-9355-5952a9141102 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:44.874105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-e6bb5659-1dfa-49e1-a070-a9115e561ed7 req-c55c93d2-2366-4d50-9355-5952a9141102 service nova] Creating event network-vif-plugged:4efa8180-10d5-4eb6-a73b-338c8f8a08e9 for instance e13340cf-6d9d-48f1-9b26-78bd805f1aed on hv-cinder-85164 Aug 25 03:30:44.879758 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-e6bb5659-1dfa-49e1-a070-a9115e561ed7 req-c55c93d2-2366-4d50-9355-5952a9141102 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031474 Aug 25 03:30:44.880409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 507/1000] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:30:45.281144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:45.281678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:45.289106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:45.289587 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:45.290024 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:45.290747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:45.291204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:45.291628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:45.418781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:45.428241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:45.430410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:45.431816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8e67594a-2df1-4f87-8179-24925bdcc815 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.156255 Aug 25 03:30:45.432383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 494/1001] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:45 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:45.907547 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1072143284", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452"}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:45.962441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] validate_networks() for None {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:30:46.454672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:46.455365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:46.462314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:46.462795 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:46.463231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:46.463979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:46.464374 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:46.464870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:46.527099 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:30:46.527545 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:30:46.528022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:30:46.528435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:30:46.528880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:30:46.538071 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:46.538592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:46.539030 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:46.539759 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:46.540214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:46.540637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:46.558149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Getting quotas for project a52f652139d7412b8ca6cce9d110fad6. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:30:46.562485 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Getting quotas for user 5f5ca6b2b6434daeaf6daf9a201c240c and project a52f652139d7412b8ca6cce9d110fad6. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:30:46.574567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:30:46.577057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:30:46.624329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:46.634067 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:46.635580 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:46.639811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f0318999-d898-4189-937a-94937f1d4421 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.186093 Aug 25 03:30:46.639811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 495/1002] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:46 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:30:46.698554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bea45627-ac98-430a-a36f-47718b9b3545 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795657 Aug 25 03:30:46.699198 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 508/1003] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:30:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:30:46.713134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ed166262-5bff-4871-9dff-bfd21c9af260 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:46.714328 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ed166262-5bff-4871-9dff-bfd21c9af260 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:46.783618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ed166262-5bff-4871-9dff-bfd21c9af260 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:46.789070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ed166262-5bff-4871-9dff-bfd21c9af260 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1215 microversion: 2.1 time: 0.082458 Aug 25 03:30:46.789668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 496/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:46 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:47.660443 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:47.661057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:47.668225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:47.668752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:47.669190 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:47.669883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:47.670380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:47.670806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:47.811189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:47.812373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:47.813633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:47.820409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:47.820921 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:47.823249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:47.823249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:47.823249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:47.823249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:47.824024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:47.825597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:47.826866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-11a2cfe1-facd-459e-a486-35208c5d3ee0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.171028 Aug 25 03:30:47.827423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 509/1005] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:47 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:47.886298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:47.888493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=89 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:47.895195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b29ee76f-5dfe-4e70-8c67-3a8fd932b16a tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1219 microversion: 2.1 time: 0.089799 Aug 25 03:30:47.895771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 497/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:47 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:48.851179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:48.851772 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:48.858098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:48.863786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:48.863786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:48.863786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:48.863786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:48.864171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:48.916448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:48.917361 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:48.931928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:48.932418 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:48.932857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:48.933563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:48.934047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:48.934755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:49.021180 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:49.023624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:49.029629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7eb60ccb-e6d3-4c77-b0be-818ae9151c33 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1275 microversion: 2.1 time: 0.117296 Aug 25 03:30:49.030353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 498/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:48 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1275 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:30:49.040876 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:49.042550 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:49.043877 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d905b27d-0811-437b-888a-b78459a89326 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1811 microversion: 2.20 time: 0.196617 Aug 25 03:30:49.044448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 510/1008] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:48 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:50.051452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:50.052074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:50.059451 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:50.060156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:50.060741 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:50.061635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:50.062322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:50.063173 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:50.067671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:50.071831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:50.075508 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:50.076448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:50.077234 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:50.078621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:50.079351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:50.079670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:50.276147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:50.284480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:50.285283 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-74993e6e-3f25-428f-9c5c-cf116a22826e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.238351 Aug 25 03:30:50.285867 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 499/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:50 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:50.294514 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:50.296618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:50.298162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e9584adc-b424-4423-b01d-b5f1f76b96e0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1798 microversion: 2.20 time: 0.235061 Aug 25 03:30:50.299108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 511/1010] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:30:50 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1798 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:30:50.929012 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-df257d56-4b7a-487b-a9d9-7c1a2f7c03bc req-8697eee3-49d5-486f-a4f9-ef33c4b13489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68431aaf-01bf-48a3-9586-140116029662", "tag": "62493eed-eeda-4011-ac32-a17e84a33977"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:50.939230 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-df257d56-4b7a-487b-a9d9-7c1a2f7c03bc req-8697eee3-49d5-486f-a4f9-ef33c4b13489 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:50.942407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-df257d56-4b7a-487b-a9d9-7c1a2f7c03bc req-8697eee3-49d5-486f-a4f9-ef33c4b13489 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:50.942407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-df257d56-4b7a-487b-a9d9-7c1a2f7c03bc req-8697eee3-49d5-486f-a4f9-ef33c4b13489 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:50.951796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-df257d56-4b7a-487b-a9d9-7c1a2f7c03bc req-8697eee3-49d5-486f-a4f9-ef33c4b13489 service nova] Creating event network-changed:62493eed-eeda-4011-ac32-a17e84a33977 for instance 68431aaf-01bf-48a3-9586-140116029662 on hv-cinder-85164 Aug 25 03:30:50.956701 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-df257d56-4b7a-487b-a9d9-7c1a2f7c03bc req-8697eee3-49d5-486f-a4f9-ef33c4b13489 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154906 Aug 25 03:30:50.957563 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 500/1011] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:30:51.306626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:51.308316 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:51.313900 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:51.314463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:51.314880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:51.315563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:51.316014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:51.316436 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:51.453085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:51.460683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-67569c1b-fe2b-4487-813f-fe5d530ecc6d tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.158023 Aug 25 03:30:51.461254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 512/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:51 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:52.482046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:52.482773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:52.489956 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:52.490549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:52.490933 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:52.491613 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:52.492062 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:52.492481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:52.619720 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:52.627219 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8680e9dc-0ac4-47c7-98c3-22668107aeac tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.149441 Aug 25 03:30:52.628353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 501/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:52 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:53.648998 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:53.649613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:53.656528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:53.657008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:53.657443 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:53.658131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:53.658680 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:53.659116 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:53.789196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:53.791512 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=87 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:53.797591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7fe63246-6d02-426e-990f-ed53b477946e tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.152433 Aug 25 03:30:53.798159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 513/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:53 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:54.818562 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:54.819183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:54.825732 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:54.826209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:54.826667 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:54.827362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:54.827808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:54.828227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:54.962490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:54.970610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9e211d5c-a1ed-4eb8-bcaa-3eabbd5889c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.156000 Aug 25 03:30:54.971702 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 502/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:54 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:55.992418 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:55.993029 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:55.999825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:56.000301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:56.000733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:56.001414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:56.001861 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:56.002327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:56.126534 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:56.134133 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e25a7c81-97b1-48b1-ad4e-7e5c85bd15c3 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.145579 Aug 25 03:30:56.134725 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 514/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:55 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:56.972518 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-602ff58e-1ddb-40fa-bdff-0c75d5406c26 req-36695789-fdfb-4e83-96c2-bc0b026c5b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68431aaf-01bf-48a3-9586-140116029662", "name": "network-vif-plugged", "status": "completed", "tag": "62493eed-eeda-4011-ac32-a17e84a33977"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:30:56.978759 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:56.983931 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-602ff58e-1ddb-40fa-bdff-0c75d5406c26 req-36695789-fdfb-4e83-96c2-bc0b026c5b33 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:56.984393 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-602ff58e-1ddb-40fa-bdff-0c75d5406c26 req-36695789-fdfb-4e83-96c2-bc0b026c5b33 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:56.984824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-602ff58e-1ddb-40fa-bdff-0c75d5406c26 req-36695789-fdfb-4e83-96c2-bc0b026c5b33 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:56.995830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-602ff58e-1ddb-40fa-bdff-0c75d5406c26 req-36695789-fdfb-4e83-96c2-bc0b026c5b33 service nova] Creating event network-vif-plugged:62493eed-eeda-4011-ac32-a17e84a33977 for instance 68431aaf-01bf-48a3-9586-140116029662 on hv-cinder-85164 Aug 25 03:30:57.000775 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-602ff58e-1ddb-40fa-bdff-0c75d5406c26 req-36695789-fdfb-4e83-96c2-bc0b026c5b33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031969 Aug 25 03:30:57.001420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 503/1017] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:30:57.155043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:57.155644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:57.157553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:57.158384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:30:57.164912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:57.164912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:57.164912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:57.165283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:57.165612 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:57.166028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:57.298091 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:57.307161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cb1140fc-91e8-43b6-a7e9-2d58f6044dca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.156075 Aug 25 03:30:57.307927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 515/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:57 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:58.332068 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:58.333322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:58.339836 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:58.340241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:58.340664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:58.341346 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:58.341792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:58.342209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:58.470640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:58.478549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-21874bc9-e720-4600-bd54-4a8876cc9321 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.154865 Aug 25 03:30:58.479115 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 504/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:58 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:30:59.499399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:30:59.500008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:30:59.507356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:59.507833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:59.508264 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:59.508942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:30:59.509390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:30:59.509812 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:30:59.645777 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:30:59.653506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a626216b-5f2a-44b2-8ac8-3e3a3dfb1009 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1315 microversion: 2.1 time: 0.157972 Aug 25 03:30:59.654069 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 516/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:30:59 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:00.673071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:00.673682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:00.680225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:00.680698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:00.681127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:00.681813 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:00.682264 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:00.682705 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:00.811681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:00.819348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c1b91ffd-129b-4089-9ac5-9a1eb314695c tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1464 microversion: 2.1 time: 0.150180 Aug 25 03:31:00.819910 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 505/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:00 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:00.863281 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:00.863780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:00.870160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:00.870670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:00.871188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:00.871881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:00.872335 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:00.872757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:00.897778 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:31:01.119040 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-987daa3f-5f49-4d6f-8cf6-ce3711d02fca tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "DELETE /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 204 len: 0 microversion: 2.1 time: 0.259334 Aug 25 03:31:01.119914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 517/1022] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:31:00 2022] DELETE /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:31:01.128218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:01.129312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:01.135353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:01.135944 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:01.136291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:01.136963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:01.137405 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:01.137815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:01.267129 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:01.275247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-71917caf-70d8-4412-bdf2-1e454f823b38 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1470 microversion: 2.1 time: 0.150918 Aug 25 03:31:01.275809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 506/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:01 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:02.296849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:02.297552 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:02.304108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:02.304591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:02.305028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:02.305718 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:02.306171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:02.306628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:02.436548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:02.444146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7ce576e7-3e83-4168-840a-189405860310 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1470 microversion: 2.1 time: 0.152060 Aug 25 03:31:02.444719 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 518/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:02 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:03.466720 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:03.467324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:03.474300 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:03.474800 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:03.475230 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:03.476004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:03.476453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:03.476870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:03.542001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ca6b2b6434daeaf6daf9a201c240c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f652139d7412b8ca6cce9d110fad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:03.549905 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8495c2b4-498a-4ad4-be90-51b6638a9862 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 200 len: 1428 microversion: 2.1 time: 0.087116 Aug 25 03:31:03.561778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 507/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:03 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:03.581004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-4b70d831-b4ba-477a-be05-3d7d1c16af3a req-3cfed454-486a-4c3d-8887-1151b2f4e3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68431aaf-01bf-48a3-9586-140116029662", "name": "network-vif-deleted", "tag": "62493eed-eeda-4011-ac32-a17e84a33977"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:31:03.594405 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b70d831-b4ba-477a-be05-3d7d1c16af3a req-3cfed454-486a-4c3d-8887-1151b2f4e3da service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:03.594893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b70d831-b4ba-477a-be05-3d7d1c16af3a req-3cfed454-486a-4c3d-8887-1151b2f4e3da service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:03.595623 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b70d831-b4ba-477a-be05-3d7d1c16af3a req-3cfed454-486a-4c3d-8887-1151b2f4e3da service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:03.611464 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-4b70d831-b4ba-477a-be05-3d7d1c16af3a req-3cfed454-486a-4c3d-8887-1151b2f4e3da service nova] Creating event network-vif-deleted:62493eed-eeda-4011-ac32-a17e84a33977 for instance 68431aaf-01bf-48a3-9586-140116029662 on hv-cinder-85164 Aug 25 03:31:03.613447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-4b70d831-b4ba-477a-be05-3d7d1c16af3a req-3cfed454-486a-4c3d-8887-1151b2f4e3da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036170 Aug 25 03:31:03.614163 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 519/1026] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:31:04.573123 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:04.573792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] [instance: 68431aaf-01bf-48a3-9586-140116029662] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:04.580700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:04.581266 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:04.581897 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:04.582738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:04.583263 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:04.583762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:04.598362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] HTTP exception thrown: Instance 68431aaf-01bf-48a3-9586-140116029662 could not be found. Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Request method failure captured: Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 HTTP/1.1 Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuzikMwIhIC0btcE6gEGjYZQC3thss_TmfvKTuU_EpGdfwfSeH6j2MknZMlZCAlNc5AaZHpsGj355JrM5ZYsgf7COdQtklcRe0LxTXQlsYlWbTgrbNlfyPavGTNCscjAlhF4hPQT8x3tSEU2dLUSvQtg1TQMx4z-EQVtCB98zcHH1Ec Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a52f652139d7412b8ca6cce9d110fad6 Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesNegativeTest-450519027 Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:31:04.599960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a52f652139d7412b8ca6cce9d110fad6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a52f652139d7412b8ca6cce9d110fad6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a52f652139d7412b8ca6cce9d110fad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a52f652139d7412b8ca6cce9d110fad6"}]}] Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesNegativeTest-450519027 Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a52f652139d7412b8ca6cce9d110fad6 Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesNegativeTest-450519027 Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesNegativeTest-450519027-project Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 5f5ca6b2b6434daeaf6daf9a201c240c Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesNegativeTest-450519027-project Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 68431aaf-01bf-48a3-9586-140116029662 could not be found. Aug 25 03:31:04.601749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '68431aaf-01bf-48a3-9586-140116029662'} Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68431aaf-01bf-48a3-9586-140116029662 could not be found. Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:31:04.607510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68431aaf-01bf-48a3-9586-140116029662 could not be found. Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68431aaf-01bf-48a3-9586-140116029662 could not be found. Aug 25 03:31:04.609096 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:04.611599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] Returning 404 to user: Instance 68431aaf-01bf-48a3-9586-140116029662 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:31:04.611599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4346c2ed-632e-45ce-a380-626b24261184 tempest-VolumesNegativeTest-450519027 tempest-VolumesNegativeTest-450519027-project] 10.222.0.58 "GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662" status: 404 len: 111 microversion: 2.1 time: 0.032245 Aug 25 03:31:04.611599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 508/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:04 2022] GET /compute/v2.1/servers/68431aaf-01bf-48a3-9586-140116029662 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:31:38.941043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:31:38.941905 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:31:38.946597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:38.947180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:38.953383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:38.956967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:38.956967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:38.956967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:38.956967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:38.957372 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:38.978001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4b38a58a-6a09-4660-8747-5783cc7b1d67 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/ips" status: 200 len: 149 microversion: 2.1 time: 0.039287 Aug 25 03:31:38.978593 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 520/1028] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Aug 25 03:31:38 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:31:40.450145 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd4fd5aa-be58-4e37-81ad-09e02cb6d0a4"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:31:40.452522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:40.455908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=35 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:31:40.456571 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=55 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:31:40.461198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:40.462848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:40.462848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:40.462848 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:40.463291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:40.463715 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:41.173616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6751be08-aa9e-49b8-a403-226e88116a5f tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "POST /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727961 Aug 25 03:31:41.174251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 509/1029] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:31:40 2022] POST /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:31:50.075595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:50.076139 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:50.084511 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:50.084988 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:50.085417 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:50.086185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:50.086657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:50.092330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:50.166730 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lazy-loading 'services' on Instance uuid 454d5736-82fe-47b0-a508-0fb6bddd1a9c {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:31:50.391777 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2f79ca30-faf2-4e36-9d66-e5d2914cf42c tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments/fd4fd5aa-be58-4e37-81ad-09e02cb6d0a4" status: 202 len: 0 microversion: 2.1 time: 0.320609 Aug 25 03:31:50.392448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 521/1030] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:31:50 2022] DELETE /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments/fd4fd5aa-be58-4e37-81ad-09e02cb6d0a4 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:31:50.406449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:50.406449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:50.410401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:50.410886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:50.411321 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:50.412015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:50.412469 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:50.412892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:50.442800 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-dd1c2f60-1e56-4419-9e88-1b36836adc14 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Aug 25 03:31:50.443382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 510/1031] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:31:50 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:31:51.456375 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:51.458706 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:51.464981 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:51.465454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:51.465880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:51.466577 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:51.467024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:51.467437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:51.496631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6217efd5-3556-4767-afba-170941c68e82 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045133 Aug 25 03:31:51.497203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 522/1032] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:31:51 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:31:52.508910 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:52.511126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:52.518136 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:52.518634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:52.519064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:52.519754 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:52.520201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:52.520622 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:52.549345 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a37f48c8-2575-4adb-a547-56ab1b5860b7 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044422 Aug 25 03:31:52.549894 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 511/1033] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 25 03:31:52 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:31:52.611388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:52.611902 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:52.618413 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:52.625381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:52.625381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:52.625381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:52.625381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:52.625776 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:52.646613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:31:52.889956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ba9a9995-6c21-4dab-b608-97f956448568 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 204 len: 0 microversion: 2.1 time: 0.282007 Aug 25 03:31:52.890505 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 523/1034] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:31:52 2022] DELETE /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:31:52.898710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:52.902362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:52.906013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:52.906531 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:52.906968 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:52.907653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:52.908105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:52.908527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:53.042661 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:53.050327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cf1c09cc-6d8e-44ae-8edf-abe55083e4a5 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1681 microversion: 2.1 time: 0.155460 Aug 25 03:31:53.050896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 512/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:52 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:54.076380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:54.076380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:54.080328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:54.080798 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:54.081230 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:54.081903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:54.082400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:54.082801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:54.214491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:54.222414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b8641fb5-f4d7-482b-84ad-a2ec86486e5a tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1681 microversion: 2.1 time: 0.154106 Aug 25 03:31:54.222986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 524/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:54 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:54.592087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:54.592581 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:54.599119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-76fc5e75-1d07-45c6-93b6-2f86927ff930 req-8d0c6d35-4ddf-4bee-a712-41249776b295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c442dfda-aec1-4ed6-aef9-3d6bfa001a70", "tag": "04db698f-a8f7-4531-90b3-5397940c09b3"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:31:54.603535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:54.604029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:54.604943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:54.605815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:54.608466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:54.608466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:54.614943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-76fc5e75-1d07-45c6-93b6-2f86927ff930 req-8d0c6d35-4ddf-4bee-a712-41249776b295 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:54.614943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-76fc5e75-1d07-45c6-93b6-2f86927ff930 req-8d0c6d35-4ddf-4bee-a712-41249776b295 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:54.614943 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-76fc5e75-1d07-45c6-93b6-2f86927ff930 req-8d0c6d35-4ddf-4bee-a712-41249776b295 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:54.623746 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-76fc5e75-1d07-45c6-93b6-2f86927ff930 req-8d0c6d35-4ddf-4bee-a712-41249776b295 service nova] Creating event network-changed:04db698f-a8f7-4531-90b3-5397940c09b3 for instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 on hv-cinder-85164 Aug 25 03:31:54.628750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-76fc5e75-1d07-45c6-93b6-2f86927ff930 req-8d0c6d35-4ddf-4bee-a712-41249776b295 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Aug 25 03:31:54.629693 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 525/1037] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:31:54.638657 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:31:54.856380 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-3b6ad316-060d-48b8-812a-7c48ab076f58 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 204 len: 0 microversion: 2.1 time: 0.267972 Aug 25 03:31:54.857171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 513/1038] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:31:54 2022] DELETE /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:31:54.865885 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:54.866610 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:54.873415 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:54.873896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:54.874357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:54.875054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:54.875687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:54.876357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:55.014203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:55.022122 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-617964a2-f9a2-4622-a809-f45798e53b0a tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1575 microversion: 2.1 time: 0.160535 Aug 25 03:31:55.022764 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 526/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:54 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:55.244161 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:55.244867 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:55.250948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:55.251430 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:55.251861 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:55.252558 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:55.253005 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:55.253428 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:55.385290 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:55.393248 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5eb21d15-78e4-4f8e-984e-dec1530dd785 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1681 microversion: 2.1 time: 0.153239 Aug 25 03:31:55.393831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 514/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:55 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:56.042567 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:56.043180 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:56.049640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:56.050121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:56.050595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:56.051281 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:56.051728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:56.052150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:56.183347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:56.191472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c021b4d1-f703-4a2b-b34c-e01585a0a23b tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1575 microversion: 2.1 time: 0.152770 Aug 25 03:31:56.192043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 527/1041] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:56 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:56.415401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:56.416635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:56.424029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:56.424771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:56.425378 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:56.426259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:56.426903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:56.427493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:56.671350 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:56.679045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-dbcc36cc-8671-4d7a-a383-64d85ad18fda tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1681 microversion: 2.1 time: 0.267473 Aug 25 03:31:56.679620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 515/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:56 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:57.214644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:57.216649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:57.223769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:57.230510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:57.230510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:57.230510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:57.230510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:57.231056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:57.251810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-e197cebb-5c7d-4c83-98d8-39f1d59ad770 req-aa6734bf-20a6-4717-8d0c-6a6c58a66b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454d5736-82fe-47b0-a508-0fb6bddd1a9c", "name": "network-vif-deleted", "tag": "a9d9c369-cdd0-4501-a5a6-1f2bea0df716"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:31:57.264353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-e197cebb-5c7d-4c83-98d8-39f1d59ad770 req-aa6734bf-20a6-4717-8d0c-6a6c58a66b62 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:57.265247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-e197cebb-5c7d-4c83-98d8-39f1d59ad770 req-aa6734bf-20a6-4717-8d0c-6a6c58a66b62 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:57.265936 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-e197cebb-5c7d-4c83-98d8-39f1d59ad770 req-aa6734bf-20a6-4717-8d0c-6a6c58a66b62 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:57.286007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-e197cebb-5c7d-4c83-98d8-39f1d59ad770 req-aa6734bf-20a6-4717-8d0c-6a6c58a66b62 service nova] Creating event network-vif-deleted:a9d9c369-cdd0-4501-a5a6-1f2bea0df716 for instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c on hv-cinder-85164 Aug 25 03:31:57.295329 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-e197cebb-5c7d-4c83-98d8-39f1d59ad770 req-aa6734bf-20a6-4717-8d0c-6a6c58a66b62 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049517 Aug 25 03:31:57.299697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 516/1043] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:31:57.403687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:57.418179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5da54771-2a44-4bb3-b2f6-cfc5c63ff4ce tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1456 microversion: 2.1 time: 0.207620 Aug 25 03:31:57.418932 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 528/1044] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:57 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1456 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:57.703470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:57.705055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:57.712712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:57.713453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:57.714201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:57.715457 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:57.715997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:57.716488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:57.725064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-7fcbcfbf-6419-4fde-8b9d-a597c73f5de2 req-5f4cbc47-bd3a-412a-9741-ef88a8e6ed33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c442dfda-aec1-4ed6-aef9-3d6bfa001a70", "name": "network-vif-deleted", "tag": "04db698f-a8f7-4531-90b3-5397940c09b3"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:31:57.735598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7fcbcfbf-6419-4fde-8b9d-a597c73f5de2 req-5f4cbc47-bd3a-412a-9741-ef88a8e6ed33 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:57.736341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7fcbcfbf-6419-4fde-8b9d-a597c73f5de2 req-5f4cbc47-bd3a-412a-9741-ef88a8e6ed33 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:57.736774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-7fcbcfbf-6419-4fde-8b9d-a597c73f5de2 req-5f4cbc47-bd3a-412a-9741-ef88a8e6ed33 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:57.748610 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-7fcbcfbf-6419-4fde-8b9d-a597c73f5de2 req-5f4cbc47-bd3a-412a-9741-ef88a8e6ed33 service nova] Creating event network-vif-deleted:04db698f-a8f7-4531-90b3-5397940c09b3 for instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 on hv-cinder-85164 Aug 25 03:31:57.752654 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:57.753584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:57.753932 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-7fcbcfbf-6419-4fde-8b9d-a597c73f5de2 req-5f4cbc47-bd3a-412a-9741-ef88a8e6ed33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032562 Aug 25 03:31:57.754373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:57.755697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lazy-loading 'fault' on Instance uuid 454d5736-82fe-47b0-a508-0fb6bddd1a9c {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:31:57.757352 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 529/1045] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:31:57.804645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b69b25b19a4addb9aff7fb7a710e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48e4c9aca394fc1a3bb497c26f2a9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:57.813749 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2bf8c7ec-4b7f-4c94-af01-be71c033763b tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 200 len: 1331 microversion: 2.1 time: 0.115692 Aug 25 03:31:57.814435 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 517/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:57 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:31:58.439783 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:58.440467 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:58.456246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:58.456246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:58.456246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:58.456246 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:58.456740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:58.456740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:58.513606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:31:58.521679 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d2cf8ed2-cade-48de-8af0-e345a0905301 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 200 len: 1224 microversion: 2.1 time: 0.086746 Aug 25 03:31:58.522314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 530/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:58 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:31:58.834910 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:58.835520 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:58.842629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:58.843105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:58.843537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:58.844228 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:58.844668 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:58.845087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:58.858412 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c HTTP/1.1 Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:31:58.860049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:31:58.861838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '454d5736-82fe-47b0-a508-0fb6bddd1a9c'} Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:31:58.862904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:31:58.864312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:58.865698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:31:58.865698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-91da2b5d-39ba-48b2-bb11-135505042779 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 404 len: 111 microversion: 2.1 time: 0.030469 Aug 25 03:31:58.865698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 518/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:58 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:31:58.870627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bf3310b0-95ac-4a8d-ae83-464dfd2e2b56 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '.version_select at 0x7fa33df49b80>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:58.947929 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bf3310b0-95ac-4a8d-ae83-464dfd2e2b56 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338019545" status: 202 len: 0 microversion: 2.1 time: 0.081206 Aug 25 03:31:58.949104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 531/1049] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Aug 25 03:31:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338019545 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:31:59.543255 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:31:59.543901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: c442dfda-aec1-4ed6-aef9-3d6bfa001a70] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:31:59.549854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:59.550347 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:59.550781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:59.551826 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:31:59.551940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:31:59.552305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:31:59.566578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] HTTP exception thrown: Instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 could not be found. Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Request method failure captured: Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 HTTP/1.1 Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBurUKuv2wxg5XM7xKWeTmTFXR29aMl7TU7ZNe6r-xpNxsYacsp9W7_RMs8pxlpsrCPLW-fBVsaYVWMsLpNZt87713IVo1hcE-ZR_KEan-dMXvNFNXXpjpDolIYFWh7sn_e04S76ZslaW-l5C4liKr-7ZOmGGW6lO5eyC4RLKAHHPqe8 Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:31:59.568112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d445535a4974186a835ab117109dca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d445535a4974186a835ab117109dca1"}]}] Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: d0a0e9c327564a3db8b89ea706f0fb36 Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 could not be found. Aug 25 03:31:59.569723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'c442dfda-aec1-4ed6-aef9-3d6bfa001a70'} Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 could not be found. Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:31:59.570737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 could not be found. Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 could not be found. Aug 25 03:31:59.572032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:31:59.573364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Returning 404 to user: Instance c442dfda-aec1-4ed6-aef9-3d6bfa001a70 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:31:59.573364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f53a1f87-1a58-4bb9-871b-c464342b7a49 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70" status: 404 len: 111 microversion: 2.1 time: 0.030688 Aug 25 03:31:59.573364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 519/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:31:59 2022] GET /compute/v2.1/servers/c442dfda-aec1-4ed6-aef9-3d6bfa001a70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:00.944712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:00.945258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:00.952171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:00.955057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:00.955057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:00.955057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:00.955057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:00.955437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:00.967819 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c HTTP/1.1 Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:32:00.969579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:00.971004 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '454d5736-82fe-47b0-a508-0fb6bddd1a9c'} Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:00.971897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:00.974224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:00.976908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:00.976908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b28e0a9a-abc7-4c55-8fea-7226f92f721d tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 404 len: 111 microversion: 2.1 time: 0.031476 Aug 25 03:32:00.976908 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 532/1051] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:32:00 2022] DELETE /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:00.983872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:00.983872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 454d5736-82fe-47b0-a508-0fb6bddd1a9c] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:00.987174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:00.987656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:00.988089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:00.988781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:00.989227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:00.989646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:01.005409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c HTTP/1.1 Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:32:01.007002 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:01.015103 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '454d5736-82fe-47b0-a508-0fb6bddd1a9c'} Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:01.016834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. Aug 25 03:32:01.019988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:01.022578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 454d5736-82fe-47b0-a508-0fb6bddd1a9c could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:01.022578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7e7690d0-48b0-4721-8e11-7875cf3f5896 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c" status: 404 len: 111 microversion: 2.1 time: 0.032978 Aug 25 03:32:01.022578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 520/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:00 2022] GET /compute/v2.1/servers/454d5736-82fe-47b0-a508-0fb6bddd1a9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:32:02.276963 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:02.277456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:02.284011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.284493 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.284924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.285619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.286066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.286511 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.300463 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 HTTP/1.1 Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:32:02.302065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.303780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '8e63fffa-925d-4288-b5b9-1ce22da25b57'} Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:02.304781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.306448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.308088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:02.308088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ecd0d10a-7aa4-47a3-a14b-c4b2712a9613 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 404 len: 111 microversion: 2.1 time: 0.030516 Aug 25 03:32:02.308088 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 533/1053] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:32:02 2022] DELETE /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:02.312934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:02.313948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 8e63fffa-925d-4288-b5b9-1ce22da25b57] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:02.320489 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.321155 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.321598 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.322356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.322805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.323225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.338776 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 HTTP/1.1 Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:32:02.340365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.341712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '8e63fffa-925d-4288-b5b9-1ce22da25b57'} Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:02.342510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. Aug 25 03:32:02.343850 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.345000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 8e63fffa-925d-4288-b5b9-1ce22da25b57 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:02.345000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5c76f3cd-a265-4f0d-b03f-993ef0d7f2da tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57" status: 404 len: 111 microversion: 2.1 time: 0.033525 Aug 25 03:32:02.345000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 521/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:02 2022] GET /compute/v2.1/servers/8e63fffa-925d-4288-b5b9-1ce22da25b57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:32:02.350356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:02.350840 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:02.357263 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.357773 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.358179 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.358899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.359350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.359771 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.373740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec HTTP/1.1 Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:32:02.375354 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.376882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '83d66607-d18c-4819-a699-018f461be7ec'} Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:02.377670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.382856 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.384266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:02.384266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f4427773-0981-4512-9349-52afeabd1702 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 404 len: 111 microversion: 2.1 time: 0.030246 Aug 25 03:32:02.384266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 534/1055] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:32:02 2022] DELETE /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:02.389185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:02.389908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 83d66607-d18c-4819-a699-018f461be7ec] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:02.395846 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.399442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.399442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.399442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:02.399442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:02.399834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:02.412212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec HTTP/1.1 Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:32:02.413773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.417881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '83d66607-d18c-4819-a699-018f461be7ec'} Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:02.419761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. Aug 25 03:32:02.421310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:02.422689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 83d66607-d18c-4819-a699-018f461be7ec could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:02.422689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b350384b-effb-4ea1-9954-5da3079615bc tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec" status: 404 len: 111 microversion: 2.1 time: 0.030005 Aug 25 03:32:02.422689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 522/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:02 2022] GET /compute/v2.1/servers/83d66607-d18c-4819-a699-018f461be7ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:03.193037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-ba2b852b-8f12-4417-9423-a29c7f4e6257 req-6022de9d-a294-4919-9cf7-fa9fcccf6c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d0cce0-fa6b-4e6c-a631-49e182a7c001", "tag": "9c589d51-6feb-4258-869a-68069ebde8f1"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:03.193897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:03.198295 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:03.206185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.206700 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.207452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.208279 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.208732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.208858 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-ba2b852b-8f12-4417-9423-a29c7f4e6257 req-6022de9d-a294-4919-9cf7-fa9fcccf6c75 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.209299 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-ba2b852b-8f12-4417-9423-a29c7f4e6257 req-6022de9d-a294-4919-9cf7-fa9fcccf6c75 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.209434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.209813 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-ba2b852b-8f12-4417-9423-a29c7f4e6257 req-6022de9d-a294-4919-9cf7-fa9fcccf6c75 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.222497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-ba2b852b-8f12-4417-9423-a29c7f4e6257 req-6022de9d-a294-4919-9cf7-fa9fcccf6c75 service nova] Creating event network-changed:9c589d51-6feb-4258-869a-68069ebde8f1 for instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 on hv-cinder-85164 Aug 25 03:32:03.227587 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-ba2b852b-8f12-4417-9423-a29c7f4e6257 req-6022de9d-a294-4919-9cf7-fa9fcccf6c75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038046 Aug 25 03:32:03.228419 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 523/1057] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:32:03.238575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:32:03.484745 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e21f6a65-0954-499c-9ed4-16101badb8f9 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 204 len: 0 microversion: 2.1 time: 0.299579 Aug 25 03:32:03.486374 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 535/1058] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:32:03 2022] DELETE /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:32:03.495632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:03.497049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:03.503745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.504377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.504742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.505474 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.505903 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.506810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.646462 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:03.653718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6c16f7db-03e7-4767-b97f-f131aa1509fd tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1576 microversion: 2.1 time: 0.162744 Aug 25 03:32:03.654302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 524/1059] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:03 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:32:03.715637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:03.716324 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:03.722689 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.723242 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.723762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.724516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.725034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.725519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.740390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 HTTP/1.1 Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:32:03.742330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.744011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '3e412db1-9619-4776-a113-7323c77edc58'} Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:03.745065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.747733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.749414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:03.749414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e1b1db2b-713a-4815-ad37-8541a6d2cef3 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 404 len: 111 microversion: 2.1 time: 0.033701 Aug 25 03:32:03.749414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 536/1060] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:32:03 2022] DELETE /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:03.754217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:03.754866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] [instance: 3e412db1-9619-4776-a113-7323c77edc58] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:03.761675 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.762405 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.763025 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.764093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:03.764711 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:03.765285 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:03.779511 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] HTTP exception thrown: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Request method failure captured: Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 HTTP/1.1 Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuqodueYkOlArJOpelx98BWMqKvFU5hXkn4a9dPHoU4uEu3X1zHzqskbtBUrwTJKwwDcQQZuvgYrrSYsmZUnpUiuggsMZ6e9HRYTUqU8NiWZFgwqEAyDN3i1uxUXqJiiRltfzcQi9vPEsi8Q293GgO3SEseh1dogC2W54Wbs6MTRi1E Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:32:03.781162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a48e4c9aca394fc1a3bb497c26f2a9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a48e4c9aca394fc1a3bb497c26f2a9f1"}]}] Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: a48e4c9aca394fc1a3bb497c26f2a9f1 Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-440863551 Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 68b69b25b19a4addb9aff7fb7a710e56 Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeNegativeTest-440863551-project Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.782853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': '3e412db1-9619-4776-a113-7323c77edc58'} Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:03.783869 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. Aug 25 03:32:03.785584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:03.787010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] Returning 404 to user: Instance 3e412db1-9619-4776-a113-7323c77edc58 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:03.787010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e99b0b1f-e653-4f7b-9f1d-fc5abc5e8cd8 tempest-AttachVolumeNegativeTest-440863551 tempest-AttachVolumeNegativeTest-440863551-project] 10.222.0.58 "GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58" status: 404 len: 111 microversion: 2.1 time: 0.032478 Aug 25 03:32:03.787010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 525/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:03 2022] GET /compute/v2.1/servers/3e412db1-9619-4776-a113-7323c77edc58 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:04.675978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:04.677245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:04.684956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:04.685649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:04.686262 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:04.687155 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:04.687768 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:04.688365 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:04.888873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:04.888873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:04.893102 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-360bba61-f8b4-48fd-94a9-b5a9d923b344 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1458 microversion: 2.1 time: 0.222106 Aug 25 03:32:04.893683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 537/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:04 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1458 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:32:04.919019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-7c738cf6-8519-4b9c-bd91-844b2ce22af4 req-9d0502d5-2653-48aa-aac7-9a464095be51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d0cce0-fa6b-4e6c-a631-49e182a7c001", "name": "network-vif-deleted", "tag": "9c589d51-6feb-4258-869a-68069ebde8f1"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:04.929342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7c738cf6-8519-4b9c-bd91-844b2ce22af4 req-9d0502d5-2653-48aa-aac7-9a464095be51 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:04.929901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7c738cf6-8519-4b9c-bd91-844b2ce22af4 req-9d0502d5-2653-48aa-aac7-9a464095be51 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:04.930440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7c738cf6-8519-4b9c-bd91-844b2ce22af4 req-9d0502d5-2653-48aa-aac7-9a464095be51 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:04.943460 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-7c738cf6-8519-4b9c-bd91-844b2ce22af4 req-9d0502d5-2653-48aa-aac7-9a464095be51 service nova] Creating event network-vif-deleted:9c589d51-6feb-4258-869a-68069ebde8f1 for instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 on hv-cinder-85164 Aug 25 03:32:04.948529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-7c738cf6-8519-4b9c-bd91-844b2ce22af4 req-9d0502d5-2653-48aa-aac7-9a464095be51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033486 Aug 25 03:32:04.949134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 526/1063] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:32:05.916283 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:05.917510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:05.937080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:05.937914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:05.938542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:05.939506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:05.940128 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:05.941543 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:05.977145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:05.977959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:05.978641 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:05.979352 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lazy-loading 'fault' on Instance uuid e5d0cce0-fa6b-4e6c-a631-49e182a7c001 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:32:06.057150 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a0e9c327564a3db8b89ea706f0fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d445535a4974186a835ab117109dca1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:06.076383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9e1b190a-8c57-405e-b9a8-b28863b42c52 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 200 len: 1230 microversion: 2.1 time: 0.159229 Aug 25 03:32:06.076383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 538/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:05 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 1230 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:32:07.094590 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:07.095342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: e5d0cce0-fa6b-4e6c-a631-49e182a7c001] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:07.101939 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:07.102459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:07.102901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:07.103608 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:07.104063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:07.104493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:07.123947 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] HTTP exception thrown: Instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 could not be found. Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Request method failure captured: Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 HTTP/1.1 Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBurUKuv2wxg5XM7xKWeTmTFXR29aMl7TU7ZNe6r-xpNxsYacsp9W7_RMs8pxlpsrCPLW-fBVsaYVWMsLpNZt87713IVo1hcE-ZR_KEan-dMXvNFNXXpjpDolIYFWh7sn_e04S76ZslaW-l5C4liKr-7ZOmGGW6lO5eyC4RLKAHHPqe8 Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:32:07.125637 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d445535a4974186a835ab117109dca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d445535a4974186a835ab117109dca1"}]}] Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: d0a0e9c327564a3db8b89ea706f0fb36 Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 could not be found. Aug 25 03:32:07.127066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'e5d0cce0-fa6b-4e6c-a631-49e182a7c001'} Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 could not be found. Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:07.127891 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 could not be found. Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 could not be found. Aug 25 03:32:07.129564 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:32:07.132080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Returning 404 to user: Instance e5d0cce0-fa6b-4e6c-a631-49e182a7c001 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:07.132080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-08ddb4dd-1584-4dc4-88d2-78105ccadd0d tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001" status: 404 len: 111 microversion: 2.1 time: 0.038952 Aug 25 03:32:07.132080 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 527/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:07 2022] GET /compute/v2.1/servers/e5d0cce0-fa6b-4e6c-a631-49e182a7c001 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:32:07.705402 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:07.706392 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:07.719195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:07.720355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:07.721619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:07.723022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:07.723817 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:07.724832 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:07.795495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-922fd988-66ad-4e13-8dba-44a0dbe91147 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments/5675628f-8952-4721-af83-ac6e8d758e3f" status: 200 len: 194 microversion: 2.20 time: 0.082751 Aug 25 03:32:07.795495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 539/1066] 10.222.0.58 () {60 vars in 1454 bytes} [Thu Aug 25 03:32:07 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments/5675628f-8952-4721-af83-ac6e8d758e3f => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:32:07.880057 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:07.880824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:07.888723 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:07.889447 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:07.890056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:07.890962 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:07.891574 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:07.892154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:07.987322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:07.991586 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lazy-loading 'services' on Instance uuid e13340cf-6d9d-48f1-9b26-78bd805f1aed {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:32:08.008494 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:08.009441 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:08.016935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:08.017894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:08.019109 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:08.023342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:08.023342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:08.023342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:08.038385 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] HTTP exception thrown: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Request method failure captured: Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: DELETE /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 HTTP/1.1 Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBurUKuv2wxg5XM7xKWeTmTFXR29aMl7TU7ZNe6r-xpNxsYacsp9W7_RMs8pxlpsrCPLW-fBVsaYVWMsLpNZt87713IVo1hcE-ZR_KEan-dMXvNFNXXpjpDolIYFWh7sn_e04S76ZslaW-l5C4liKr-7ZOmGGW6lO5eyC4RLKAHHPqe8 Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:32:08.039942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d445535a4974186a835ab117109dca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d445535a4974186a835ab117109dca1"}]}] Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: d0a0e9c327564a3db8b89ea706f0fb36 Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.041642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '733fa4c6-b3ef-4350-a501-bbebf3ce0a19'} Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:08.042426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.043738 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.046598 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Returning 404 to user: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:08.047566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c637adf9-81d5-48cc-b227-6762c38e1916 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 404 len: 111 microversion: 2.1 time: 0.042988 Aug 25 03:32:08.048196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 540/1067] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:32:08 2022] DELETE /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:32:08.056137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:08.056782 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] [instance: 733fa4c6-b3ef-4350-a501-bbebf3ce0a19] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:08.063550 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:08.064036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:08.064472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:08.065171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:08.065625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:08.066050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:08.080249 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] HTTP exception thrown: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Request method failure captured: Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 HTTP/1.1 Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBurUKuv2wxg5XM7xKWeTmTFXR29aMl7TU7ZNe6r-xpNxsYacsp9W7_RMs8pxlpsrCPLW-fBVsaYVWMsLpNZt87713IVo1hcE-ZR_KEan-dMXvNFNXXpjpDolIYFWh7sn_e04S76ZslaW-l5C4liKr-7ZOmGGW6lO5eyC4RLKAHHPqe8 Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:32:08.081794 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5d445535a4974186a835ab117109dca1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5d445535a4974186a835ab117109dca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5d445535a4974186a835ab117109dca1"}]}] Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 5d445535a4974186a835ab117109dca1 Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1971195002 Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: d0a0e9c327564a3db8b89ea706f0fb36 Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestVolumeBootPattern-1971195002-project Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.083307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '733fa4c6-b3ef-4350-a501-bbebf3ce0a19'} Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:08.084228 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. Aug 25 03:32:08.085492 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:08.093358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Returning 404 to user: Instance 733fa4c6-b3ef-4350-a501-bbebf3ce0a19 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:08.093358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-24f06521-16e3-4edc-9235-5540b06c6948 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19" status: 404 len: 111 microversion: 2.1 time: 0.030875 Aug 25 03:32:08.093358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 541/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:08 2022] GET /compute/v2.1/servers/733fa4c6-b3ef-4350-a501-bbebf3ce0a19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:32:08.288154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-95cc1183-7113-4f95-862f-2d52497f4e83 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments/5675628f-8952-4721-af83-ac6e8d758e3f" status: 202 len: 0 microversion: 2.20 time: 0.411806 Aug 25 03:32:08.288762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 528/1069] 10.222.0.58 () {60 vars in 1457 bytes} [Thu Aug 25 03:32:07 2022] DELETE /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments/5675628f-8952-4721-af83-ac6e8d758e3f => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:32:08.297708 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:08.299900 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:08.305781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:08.306270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:08.306750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:08.307447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:08.307933 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:08.309186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:08.344244 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-38bc5b36-0930-4a78-8316-a4472be0501c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050925 Aug 25 03:32:08.348818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 542/1070] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Aug 25 03:32:08 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:32:09.360599 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:09.362897 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:09.369135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:09.369616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:09.370472 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:09.370808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:09.371788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:09.372214 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:09.403061 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a9841aa0-620e-424e-8ac7-32a4ba7ffd67 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047219 Aug 25 03:32:09.403533 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 529/1071] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Aug 25 03:32:09 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:32:09.468632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:09.469898 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:09.476098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:09.479636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:09.479636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:09.479636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:09.479636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:09.480042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:09.505213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:32:09.686070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-52bd814f-beb4-473f-9760-0c06a9ac8215 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] Calling method '.version_select at 0x7fa33a7c4670>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:09.742031 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-52bd814f-beb4-473f-9760-0c06a9ac8215 tempest-TestVolumeBootPattern-1971195002 tempest-TestVolumeBootPattern-1971195002-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-906870696" status: 202 len: 0 microversion: 2.1 time: 0.060586 Aug 25 03:32:09.742652 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 530/1072] 10.222.0.58 () {58 vars in 1260 bytes} [Thu Aug 25 03:32:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-906870696 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:32:09.811047 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f29bf752-d4b6-4baa-a22a-a94b26ce20f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 204 len: 0 microversion: 2.20 time: 0.346016 Aug 25 03:32:09.811917 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 543/1073] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Aug 25 03:32:09 2022] DELETE /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 03:32:09.821728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:09.822748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:09.829182 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:09.829862 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:09.830400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:09.831189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:09.831718 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:09.832401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:09.973423 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:09.983289 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:09.985099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:09.986743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-f992816b-34a0-444e-a1ce-1e7b96bdd6f0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.170393 Aug 25 03:32:09.988254 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 531/1074] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:09 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:11.012998 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:11.013730 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:11.021105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:11.021588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:11.022028 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:11.022780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:11.023227 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:11.023654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:11.186240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:11.194389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:11.195963 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:11.197127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9d86b1b2-11ca-40dc-a349-954b57253f61 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.189934 Aug 25 03:32:11.197701 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 544/1075] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:11 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:12.221262 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:12.222655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:12.225487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:12.235566 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:12.236054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:12.236491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:12.241632 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:12.242124 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:12.242594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:12.482984 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:12.500278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:12.500278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:12.501403 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-93124df7-bc40-49ff-871b-cfc8e4220073 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1726 microversion: 2.20 time: 0.284120 Aug 25 03:32:12.501950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 532/1076] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:12 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1726 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:12.791630 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-85ff43c7-a80d-44d2-9590-c32c0be456ce req-e5b30f11-a851-4d94-afff-a5a3fd1da323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13340cf-6d9d-48f1-9b26-78bd805f1aed", "name": "network-vif-deleted", "tag": "4efa8180-10d5-4eb6-a73b-338c8f8a08e9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:12.804523 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-85ff43c7-a80d-44d2-9590-c32c0be456ce req-e5b30f11-a851-4d94-afff-a5a3fd1da323 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:12.812748 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-85ff43c7-a80d-44d2-9590-c32c0be456ce req-e5b30f11-a851-4d94-afff-a5a3fd1da323 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:12.813268 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-85ff43c7-a80d-44d2-9590-c32c0be456ce req-e5b30f11-a851-4d94-afff-a5a3fd1da323 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:12.832554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-85ff43c7-a80d-44d2-9590-c32c0be456ce req-e5b30f11-a851-4d94-afff-a5a3fd1da323 service nova] Creating event network-vif-deleted:4efa8180-10d5-4eb6-a73b-338c8f8a08e9 for instance e13340cf-6d9d-48f1-9b26-78bd805f1aed on hv-cinder-85164 Aug 25 03:32:12.848958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-85ff43c7-a80d-44d2-9590-c32c0be456ce req-e5b30f11-a851-4d94-afff-a5a3fd1da323 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061278 Aug 25 03:32:12.852640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 545/1077] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:32:13.536993 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:13.539347 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:13.556710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:13.557385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:13.563931 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:13.564801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:13.565280 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:13.569067 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:13.627149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:13.627636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:13.628075 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:13.628522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lazy-loading 'fault' on Instance uuid e13340cf-6d9d-48f1-9b26-78bd805f1aed {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:32:13.715666 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:13.725386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:13.727617 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:13.729087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6492cbca-d8be-4862-aee5-df9f296d7625 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 200 len: 1372 microversion: 2.20 time: 0.208091 Aug 25 03:32:13.729974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 533/1078] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:13 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:14.752909 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:14.753691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:14.760801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:14.761844 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:14.762085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:14.762874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:14.763394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:14.763885 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:14.778126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] HTTP exception thrown: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Request method failure captured: Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed HTTP/1.1 Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuwc8L8uKM4DNNX0PwZoNsbqmFFU_RAUS3tXzCMQR_843EpoItbSWYuIJDhYpQsrDRaIYQ-jCsF4VXpmGEzaWyNRYNaupIK0HKi_dbOyVXIMi7eFoR-Rj0-vYnUcmVEHGI4hG9x28vwtkIKUrQZ_wnQsO4OpbTI6nqVdRcv0hejqW4k Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:32:14.779839 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e22a25921ea45eba0f29a87edaba447"}]}] Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 08a52103c0f4467c8366bd88e8b655e9 Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:32:14.785482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'e13340cf-6d9d-48f1-9b26-78bd805f1aed'} Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:32:14.786452 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:32:14.787966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:32:14.789318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Returning 404 to user: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:32:14.789318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b7337d3a-4210-4b91-ad3d-30d82c3156d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 404 len: 111 microversion: 2.20 time: 0.033008 Aug 25 03:32:14.789318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 546/1079] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:14 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:32:14.790314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4332fbb1-9adf-49be-9f9a-560194690840 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '.version_select at 0x7fa33a7ccc10>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:14.896009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4332fbb1-9adf-49be-9f9a-560194690840 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308210535" status: 204 len: 0 microversion: 2.20 time: 0.109432 Aug 25 03:32:14.896725 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 534/1080] 10.222.0.58 () {60 vars in 1262 bytes} [Thu Aug 25 03:32:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308210535 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 03:32:15.669680 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0d61232a-139d-453a-aaee-673633d8f0e7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'create', calling method: .version_select at 0x7fa33a80a0d0>, body: {"keypair": {"name": "tempest-keypair-2027313204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfEbv+m5oDXM5ivoYucJ57SE2LchgMPLi4DoCLkyD0QAOULcpbYabnleukkVkCyxlzXOOZLN4BWsZfA/i2WIly0kf99qwWgvbyVwNwoXjSiurFPa8vPZG7r33Chq5/mMQ=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:15.686498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-0d61232a-139d-453a-aaee-673633d8f0e7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for project 3e22a25921ea45eba0f29a87edaba447. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:32:15.693560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-0d61232a-139d-453a-aaee-673633d8f0e7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for user 08a52103c0f4467c8366bd88e8b655e9 and project 3e22a25921ea45eba0f29a87edaba447. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:32:15.759103 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0d61232a-139d-453a-aaee-673633d8f0e7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.093710 Aug 25 03:32:15.765716 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 547/1081] 10.222.0.58 () {62 vars in 1200 bytes} [Thu Aug 25 03:32:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 03:32:18.584417 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-499520271", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3297349b-20d8-4bb0-a13e-dac189a991a3"}], "security_groups": [{"name": "tempest-securitygroup--1861724270"}], "key_name": "tempest-keypair-2027313204", "user_data": "}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:18.713758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] validate_networks() for [('3297349b-20d8-4bb0-a13e-dac189a991a3', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:32:19.109383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:32:19.109831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:32:19.110494 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:32:19.110930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:32:19.111343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:32:19.120008 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:19.120601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:19.121761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:19.122588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:19.123048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:19.123472 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:19.144515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for project 3e22a25921ea45eba0f29a87edaba447. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:32:19.148664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Getting quotas for user 08a52103c0f4467c8366bd88e8b655e9 and project 3e22a25921ea45eba0f29a87edaba447. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:32:19.173007 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:32:19.175689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:32:19.264583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b8e05db1-5d56-40cc-93ce-3f7dcf922b14 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.687163 Aug 25 03:32:19.265227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 535/1082] 10.222.0.58 () {62 vars in 1188 bytes} [Thu Aug 25 03:32:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 03:32:19.278980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-851f2903-12bc-4ec2-b774-905c6afbdda9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:19.280318 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-851f2903-12bc-4ec2-b774-905c6afbdda9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:19.347372 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-851f2903-12bc-4ec2-b774-905c6afbdda9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:19.357545 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-851f2903-12bc-4ec2-b774-905c6afbdda9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:19.359597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-851f2903-12bc-4ec2-b774-905c6afbdda9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:19.365213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-851f2903-12bc-4ec2-b774-905c6afbdda9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1281 microversion: 2.20 time: 0.088250 Aug 25 03:32:19.365213 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 548/1083] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:19 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:20.383998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:20.388298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:20.390740 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:20.391213 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:20.391843 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:20.392541 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:20.393120 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:20.393416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:20.489093 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:20.501616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:20.504497 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:20.506527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2b720d56-73e6-40a4-a5dd-84dd11c34b0e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1285 microversion: 2.20 time: 0.126817 Aug 25 03:32:20.507421 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 536/1084] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:20 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:21.535530 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:21.536315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:21.540357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:21.544440 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:21.544925 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:21.545363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:21.546205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:21.546554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:21.547188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:21.614064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:21.622831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:21.624433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:21.625548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e7fd3b37-48c6-4b96-ba6a-ce6f7c999af8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1351 microversion: 2.20 time: 0.093915 Aug 25 03:32:21.626104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 549/1085] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:21 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:22.649166 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:22.649746 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:22.656984 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:22.657455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:22.657944 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:22.658703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:22.659147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:22.659562 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:22.797171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:22.806684 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:22.813402 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:22.813402 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-350c92dc-c79a-49c0-9d08-7b97fc458360 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.166216 Aug 25 03:32:22.813402 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 537/1086] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:22 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:22.998216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-288dc47d-29e0-4397-9b54-573355899a00 req-7755710c-1441-4535-b665-a3db82a7b42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d3cf80-7d6d-476e-8bdf-505e26458720", "tag": "c4e50523-60cc-43ab-a3c5-8e6094960565"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:23.008780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-288dc47d-29e0-4397-9b54-573355899a00 req-7755710c-1441-4535-b665-a3db82a7b42c service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:23.009548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-288dc47d-29e0-4397-9b54-573355899a00 req-7755710c-1441-4535-b665-a3db82a7b42c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:23.009980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-288dc47d-29e0-4397-9b54-573355899a00 req-7755710c-1441-4535-b665-a3db82a7b42c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:23.021369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-288dc47d-29e0-4397-9b54-573355899a00 req-7755710c-1441-4535-b665-a3db82a7b42c service nova] Creating event network-changed:c4e50523-60cc-43ab-a3c5-8e6094960565 for instance e7d3cf80-7d6d-476e-8bdf-505e26458720 on hv-cinder-85164 Aug 25 03:32:23.026455 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-288dc47d-29e0-4397-9b54-573355899a00 req-7755710c-1441-4535-b665-a3db82a7b42c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032776 Aug 25 03:32:23.027057 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 550/1087] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:32:24.006064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:24.006814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:24.013306 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:24.019014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:24.019014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:24.019014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:24.019014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:24.019420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:24.149166 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:24.160882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:24.162698 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:24.163859 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0b40f50e-b872-447f-94bf-c02cca1bea93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.331876 Aug 25 03:32:24.164678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 538/1088] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:23 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:25.189989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:25.190787 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:25.197258 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:25.197884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:25.198348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:25.199035 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:25.199552 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:25.199937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:25.346489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:25.355710 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:25.357266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:25.358415 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-179e3c37-8e3c-4f6d-9614-4f98ff4f880a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.173522 Aug 25 03:32:25.358978 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 551/1089] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:25 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:26.381202 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:26.381953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:26.388478 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:26.388958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:26.389387 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:26.390072 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:26.390616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:26.391034 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:26.529967 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:26.538215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:26.539992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:26.541107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-95492c28-ae29-481d-aaf5-d93573254d4d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.163906 Aug 25 03:32:26.541677 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 539/1090] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:26 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:27.563666 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:27.564284 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:27.570760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:27.571245 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:27.571724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:27.572422 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:27.572873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:27.573302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:27.719126 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:27.729012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:27.729286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:27.731040 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c0e4795e-9318-4cde-860f-cacb5a95d2a1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.170831 Aug 25 03:32:27.731617 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 552/1091] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:27 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:28.753156 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:28.753764 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:28.760201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:28.760687 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:28.761121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:28.761809 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:28.762259 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:28.762704 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:28.894170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:28.903064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:28.904579 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:28.905688 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7213d8ca-8702-46c2-8adc-3a812a8da866 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.156456 Aug 25 03:32:28.906241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 540/1092] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:28 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:29.256760 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-cbc3aed5-8146-4a7a-bfda-ceb45a514952 req-bac552ea-a4ce-403f-bf45-0bc216c053d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3cf80-7d6d-476e-8bdf-505e26458720", "name": "network-vif-plugged", "status": "completed", "tag": "c4e50523-60cc-43ab-a3c5-8e6094960565"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:29.268471 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-cbc3aed5-8146-4a7a-bfda-ceb45a514952 req-bac552ea-a4ce-403f-bf45-0bc216c053d4 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:29.268948 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-cbc3aed5-8146-4a7a-bfda-ceb45a514952 req-bac552ea-a4ce-403f-bf45-0bc216c053d4 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:29.269377 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-cbc3aed5-8146-4a7a-bfda-ceb45a514952 req-bac552ea-a4ce-403f-bf45-0bc216c053d4 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:29.280841 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-cbc3aed5-8146-4a7a-bfda-ceb45a514952 req-bac552ea-a4ce-403f-bf45-0bc216c053d4 service nova] Creating event network-vif-plugged:c4e50523-60cc-43ab-a3c5-8e6094960565 for instance e7d3cf80-7d6d-476e-8bdf-505e26458720 on hv-cinder-85164 Aug 25 03:32:29.285668 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-cbc3aed5-8146-4a7a-bfda-ceb45a514952 req-bac552ea-a4ce-403f-bf45-0bc216c053d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Aug 25 03:32:29.286267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 553/1093] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:32:29.929294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:29.929896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:29.931893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:29.932709 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:29.938802 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:29.939272 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:29.939696 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:29.940383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:29.940841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:29.941261 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:30.078651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:30.086747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:30.088438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:30.090206 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bb1fc842-3662-4d52-9fb2-51fe095e4cca tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.164428 Aug 25 03:32:30.090840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 541/1094] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:29 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:31.109802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:31.114626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:31.115325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:31.122804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:31.123303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:31.137830 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:31.137830 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:31.137830 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:31.137830 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:31.257588 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:31.266065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:31.267618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:31.268747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-be0306ef-9b43-4bf0-976c-9151815b5f8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1407 microversion: 2.20 time: 0.159932 Aug 25 03:32:31.269315 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 554/1095] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:31 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:32.291407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:32.292038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:32.299345 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:32.299842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:32.300409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:32.301200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:32.301807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:32.302556 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:32.441112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:32.449153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:32.450696 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:32.451842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2d2b5482-80a7-405d-9680-c0eff979fba6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1599 microversion: 2.20 time: 0.164487 Aug 25 03:32:32.452391 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 542/1096] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:32:32 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:32:32.473833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:32.474462 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:32.482080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:32.482585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:32.483225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:32.483759 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:32.484194 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:32.484621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:32.562118 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-00199c7b-7720-488b-baa4-83e0b94bc4ac tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092170 Aug 25 03:32:32.562767 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 555/1097] 10.222.0.58 () {60 vars in 1316 bytes} [Thu Aug 25 03:32:32 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:32:33.573067 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-845fea14-8924-4d52-9eef-0261b2c85dfc req-cc802605-f1f3-4c89-8242-4a98f0311fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d3cf80-7d6d-476e-8bdf-505e26458720", "tag": "c4e50523-60cc-43ab-a3c5-8e6094960565"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:33.583424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-845fea14-8924-4d52-9eef-0261b2c85dfc req-cc802605-f1f3-4c89-8242-4a98f0311fc9 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:33.583987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-845fea14-8924-4d52-9eef-0261b2c85dfc req-cc802605-f1f3-4c89-8242-4a98f0311fc9 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:33.584485 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-845fea14-8924-4d52-9eef-0261b2c85dfc req-cc802605-f1f3-4c89-8242-4a98f0311fc9 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:33.596580 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-845fea14-8924-4d52-9eef-0261b2c85dfc req-cc802605-f1f3-4c89-8242-4a98f0311fc9 service nova] Creating event network-changed:c4e50523-60cc-43ab-a3c5-8e6094960565 for instance e7d3cf80-7d6d-476e-8bdf-505e26458720 on hv-cinder-85164 Aug 25 03:32:33.602477 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-845fea14-8924-4d52-9eef-0261b2c85dfc req-cc802605-f1f3-4c89-8242-4a98f0311fc9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033384 Aug 25 03:32:33.603106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 543/1098] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:32:58.897435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=13 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:58.902224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:58.902224 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-390032148", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "networks": [{"uuid": "c43ef05b-fb83-4731-af94-56b52e4a40c9"}]}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:32:58.955152 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.network.neutron [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] validate_networks() for [('c43ef05b-fb83-4731-af94-56b52e4a40c9', None, None, None, None, None)] {{(pid=121277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:32:59.351834 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Flavor limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:32:59.355801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Image limits 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:32:59.355801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Flavor pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:32:59.355801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Image pref 0:0:0 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:32:59.355801 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.virt.hardware [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:32:59.362822 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:59.363303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:59.363734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:59.364451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:32:59.364901 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:32:59.365319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:32:59.382244 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Getting quotas for project 0b8107c0e697482ea144a7026a568ff3. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:32:59.386141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Getting quotas for user 43d7031613814c0eb40662b3b893bd49 and project 0b8107c0e697482ea144a7026a568ff3. Resources: {'instances', 'cores', 'ram'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:32:59.398901 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Going to run 1 instances... {{(pid=121277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:32:59.399464 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:32:59.517903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-109f8e59-894c-4145-bc9c-61b46ad9fca2 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622308 Aug 25 03:32:59.518566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 556/1099] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:32:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:32:59.528131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:59.528947 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:32:59.534339 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-997d3adf-b957-4e3c-9552-3785458a844a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:32:59.535146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-997d3adf-b957-4e3c-9552-3785458a844a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:32:59.594596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-997d3adf-b957-4e3c-9552-3785458a844a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:32:59.604651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-997d3adf-b957-4e3c-9552-3785458a844a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1218 microversion: 2.1 time: 0.076312 Aug 25 03:32:59.604651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 544/1100] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:32:59 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:00.625485 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:00.626015 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:00.633087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:00.633572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:00.634030 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:00.635472 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:00.635930 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:00.636364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:00.699480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:00.707274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-098bff51-834c-4a55-899b-cd95146e1544 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1222 microversion: 2.1 time: 0.086746 Aug 25 03:33:00.707842 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 557/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:00 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:01.732305 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:01.732899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:01.740467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:01.740943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:01.741376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:01.742056 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:01.742532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:01.743038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:01.818487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:01.830977 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-21106e9f-d1b0-446c-873f-47aad88f175a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1288 microversion: 2.1 time: 0.102229 Aug 25 03:33:01.831569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 545/1102] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:01 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:02.852226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:02.852842 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:02.859267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:02.860368 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:02.860815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:02.861506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:02.861963 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:02.862416 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:02.989289 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:02.996922 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b7d364ac-a193-4772-853f-c1ae4043e30d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.148563 Aug 25 03:33:02.997498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 558/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:02 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:03.042575 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-eabf01f5-0ab4-4629-b201-58894ed992a6 req-8b9e3aba-f548-4dbc-afaf-7f29f9f2488c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e2ffed-b4fa-464a-a069-2d4e0332bf03", "tag": "d2b0d413-c7e2-41cf-9961-1c88db8e0679"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:33:03.052612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-eabf01f5-0ab4-4629-b201-58894ed992a6 req-8b9e3aba-f548-4dbc-afaf-7f29f9f2488c service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:03.053085 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-eabf01f5-0ab4-4629-b201-58894ed992a6 req-8b9e3aba-f548-4dbc-afaf-7f29f9f2488c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:03.053506 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-eabf01f5-0ab4-4629-b201-58894ed992a6 req-8b9e3aba-f548-4dbc-afaf-7f29f9f2488c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:03.064381 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-eabf01f5-0ab4-4629-b201-58894ed992a6 req-8b9e3aba-f548-4dbc-afaf-7f29f9f2488c service nova] Creating event network-changed:d2b0d413-c7e2-41cf-9961-1c88db8e0679 for instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 on hv-cinder-85164 Aug 25 03:33:03.071073 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-eabf01f5-0ab4-4629-b201-58894ed992a6 req-8b9e3aba-f548-4dbc-afaf-7f29f9f2488c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031862 Aug 25 03:33:03.076854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 546/1104] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:33:04.017732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:04.018351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:04.024755 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:04.025237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:04.025671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:04.026388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:04.026843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:04.027266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:04.162148 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:04.169804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9a6dfbf7-962a-4408-91f2-2597f39a902a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.156009 Aug 25 03:33:04.170395 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 559/1105] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:04 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:05.191907 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:05.192603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:05.199294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:05.199770 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:05.200197 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:05.200878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:05.201327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:05.201746 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:05.328777 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:05.336390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b09bc541-af18-49a7-b98e-12c7de6e447a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.148768 Aug 25 03:33:05.336953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 547/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:05 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:06.357226 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:06.357862 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:06.365201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:06.365714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:06.366188 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:06.366944 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:06.367397 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:06.367820 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:06.500597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:06.508191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-63dceb0c-3259-42c3-b3bc-88816aba7537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.155013 Aug 25 03:33:06.508756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 560/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:06 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:07.529167 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:07.529998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:07.536468 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:07.536948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:07.537383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:07.538071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:07.538554 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:07.538979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:07.668061 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:07.676403 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a23c4579-346a-4182-a5c8-c797b9848da6 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.151164 Aug 25 03:33:07.676969 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 548/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:07 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:08.698093 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:08.698729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:08.705920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:08.706430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:08.711095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:08.711095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:08.711095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:08.711095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:08.839851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:08.847439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f781ba83-edd2-453a-82be-b178eaee154d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.153324 Aug 25 03:33:08.848012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 561/1109] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:08 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:09.869106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:09.869748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:09.872700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:33:09.877549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:09.878018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:09.878476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:09.879160 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:09.879604 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:09.880016 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:10.011934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:10.020270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a59a181b-2b51-442e-89ed-b8f3ae133058 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.155135 Aug 25 03:33:10.021198 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 549/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:09 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:11.041433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:11.041961 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:11.044558 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:33:11.045347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=6 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:33:11.050634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:11.051116 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:11.058018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:11.058018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:11.058018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:11.058018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:11.179741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:11.187573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fb034645-bacc-4566-8176-cabc9e5d9961 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.150145 Aug 25 03:33:11.188146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 562/1111] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:11 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:11.513686 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-75e9d086-99cb-42c4-a04c-287d403c29af req-5a0c4655-dd12-42b7-b62c-2e3d8b74c996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e2ffed-b4fa-464a-a069-2d4e0332bf03", "name": "network-vif-plugged", "status": "completed", "tag": "d2b0d413-c7e2-41cf-9961-1c88db8e0679"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:33:11.524232 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-75e9d086-99cb-42c4-a04c-287d403c29af req-5a0c4655-dd12-42b7-b62c-2e3d8b74c996 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:11.525017 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-75e9d086-99cb-42c4-a04c-287d403c29af req-5a0c4655-dd12-42b7-b62c-2e3d8b74c996 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:11.525343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-75e9d086-99cb-42c4-a04c-287d403c29af req-5a0c4655-dd12-42b7-b62c-2e3d8b74c996 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:11.536158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-75e9d086-99cb-42c4-a04c-287d403c29af req-5a0c4655-dd12-42b7-b62c-2e3d8b74c996 service nova] Creating event network-vif-plugged:d2b0d413-c7e2-41cf-9961-1c88db8e0679 for instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 on hv-cinder-85164 Aug 25 03:33:11.541301 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-75e9d086-99cb-42c4-a04c-287d403c29af req-5a0c4655-dd12-42b7-b62c-2e3d8b74c996 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031242 Aug 25 03:33:11.541876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 550/1112] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:33:12.208362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:12.209031 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:12.215626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:12.216104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:12.216533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:12.217247 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:12.217691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:12.218107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:12.350806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:12.358342 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6b8bb292-68f2-4eef-9e1c-ccc56487023b tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.153837 Aug 25 03:33:12.358913 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 563/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:12 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:13.381241 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:13.381932 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:13.388659 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:13.389195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:13.389621 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:13.390308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:13.390950 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:13.391365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:13.518482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:13.526094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c526aee6-31cc-4104-b258-57899c252392 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1318 microversion: 2.1 time: 0.149205 Aug 25 03:33:13.526911 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 551/1114] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:13 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:14.546574 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:33:14.547190 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:14.553690 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:14.554171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:14.554644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:14.555336 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:14.555790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:14.556217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:14.689131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:33:14.696892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a9bf9379-4ef1-40ee-aaa0-3ea3257ca24e tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1508 microversion: 2.1 time: 0.154255 Aug 25 03:33:14.697556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 564/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:33:14 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:33:36.436217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cfaec82-d165-4732-9092-479653b1c8e5", "device": "/dev/sdb"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:33:36.439195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:33:36.442740 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=18 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:33:36.443728 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=34 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:33:36.450358 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:36.450842 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:36.451278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:36.451976 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:33:36.452429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:33:36.452854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:33:37.086682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4adb2d32-d448-489a-ace0-2f93a8ea28ea tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "POST /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655173 Aug 25 03:33:37.087270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 552/1116] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:33:36 2022] POST /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:34:04.754945 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:04.759692 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:04.759692 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:04.759692 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=50 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:04.764148 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:04.764638 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:04.765066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:04.765757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:04.766211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:04.766686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:04.958914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lazy-loading 'services' on Instance uuid 10e2ffed-b4fa-464a-a069-2d4e0332bf03 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:34:05.143827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4692414e-4c42-4fe3-b335-ee52c2db7a8c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03/os-volume_attachments/7cfaec82-d165-4732-9092-479653b1c8e5" status: 202 len: 0 microversion: 2.1 time: 0.392899 Aug 25 03:34:05.144469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 565/1117] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:34:04 2022] DELETE /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03/os-volume_attachments/7cfaec82-d165-4732-9092-479653b1c8e5 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:34:07.321281 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:07.322076 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:07.326130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:07.327778 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:07.333246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:07.333727 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:07.334181 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:07.334892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:07.335348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:07.336299 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:07.361226 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:34:07.630508 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c95d2c49-177b-4a00-95ee-efa0bfdbc9fa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 204 len: 0 microversion: 2.1 time: 0.311017 Aug 25 03:34:07.631033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 553/1118] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:34:07 2022] DELETE /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:34:07.641349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:07.642050 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:07.648865 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:07.650519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:07.650519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:07.650519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:07.650951 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:07.651288 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:07.786563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:07.794428 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-580fe2e1-f07e-48ee-a172-bbe1ab2bfe13 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1514 microversion: 2.1 time: 0.157883 Aug 25 03:34:07.795183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 566/1119] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:07 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:08.816593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:08.817294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:08.824170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:08.824765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:08.825189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:08.825865 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:08.826326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:08.826743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:08.956927 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:08.965078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-28eaf275-c53d-40f0-b559-0be1d9c58337 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1514 microversion: 2.1 time: 0.152684 Aug 25 03:34:08.965658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 554/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:08 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:09.987146 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:09.987775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:09.994421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:09.995184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:09.995325 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:09.996030 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:09.996484 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:09.997345 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:10.225479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-e7ae8a43-47d6-4c14-826a-eee925bf9d07 req-d65c2907-8f0b-42d3-868b-6884c4112e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e2ffed-b4fa-464a-a069-2d4e0332bf03", "name": "network-vif-deleted", "tag": "d2b0d413-c7e2-41cf-9961-1c88db8e0679"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:10.236238 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-e7ae8a43-47d6-4c14-826a-eee925bf9d07 req-d65c2907-8f0b-42d3-868b-6884c4112e51 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:10.239287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-e7ae8a43-47d6-4c14-826a-eee925bf9d07 req-d65c2907-8f0b-42d3-868b-6884c4112e51 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:10.239287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-e7ae8a43-47d6-4c14-826a-eee925bf9d07 req-d65c2907-8f0b-42d3-868b-6884c4112e51 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:10.239513 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:10.247102 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a28e76e7-ef17-4607-a9f5-e5d4c03bb328 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 200 len: 1514 microversion: 2.1 time: 0.264078 Aug 25 03:34:10.251390 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 567/1121] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:09 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:10.251797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-e7ae8a43-47d6-4c14-826a-eee925bf9d07 req-d65c2907-8f0b-42d3-868b-6884c4112e51 service nova] Creating event network-vif-deleted:d2b0d413-c7e2-41cf-9961-1c88db8e0679 for instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 on hv-cinder-85164 Aug 25 03:34:10.253948 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-e7ae8a43-47d6-4c14-826a-eee925bf9d07 req-d65c2907-8f0b-42d3-868b-6884c4112e51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Aug 25 03:34:10.254621 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 555/1122] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:34:11.269266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:11.269889 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: 10e2ffed-b4fa-464a-a069-2d4e0332bf03] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:11.276345 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:11.276811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:11.277237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:11.277920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:11.278394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:11.278810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:11.292389 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] HTTP exception thrown: Instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 could not be found. Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Request method failure captured: Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 HTTP/1.1 Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBu1oCtGY8BUMldyhFWlnNNOMijZtnPbcQLgakqRq07L1ysFATyktO1qOniNVyx15djt6Ze1InZv8HISdyD1cMoPIU128jtMoRNf1nNrLIBekf6jYTGt8A19jFPBUOTysUMlmQy0OlSlZIDbHxHu3tl_tkHWeovKh_ubXbW5r2w0TuQY Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 0b8107c0e697482ea144a7026a568ff3 Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-VolumesSnapshotTestJSON-323951136 Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:34:11.293991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b8107c0e697482ea144a7026a568ff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b8107c0e697482ea144a7026a568ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b8107c0e697482ea144a7026a568ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b8107c0e697482ea144a7026a568ff3"}]}] Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-VolumesSnapshotTestJSON-323951136 Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 0b8107c0e697482ea144a7026a568ff3 Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-323951136 Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-VolumesSnapshotTestJSON-323951136-project Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 43d7031613814c0eb40662b3b893bd49 Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-VolumesSnapshotTestJSON-323951136-project Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 could not be found. Aug 25 03:34:11.295806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '10e2ffed-b4fa-464a-a069-2d4e0332bf03'} Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 could not be found. Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:34:11.296893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 could not be found. Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 could not be found. Aug 25 03:34:11.298724 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:34:11.300177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Returning 404 to user: Instance 10e2ffed-b4fa-464a-a069-2d4e0332bf03 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:34:11.300177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-87bf98cd-b043-41f4-9a45-72db8625b9ed tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03" status: 404 len: 111 microversion: 2.1 time: 0.030238 Aug 25 03:34:11.300177 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 568/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:11 2022] GET /compute/v2.1/servers/10e2ffed-b4fa-464a-a069-2d4e0332bf03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:34:13.156833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:13.157415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:13.164527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:13.165004 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:13.165438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:13.166126 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:13.166613 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:13.167039 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:13.190170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-c5377d63-5034-4e20-ad50-3d6d13793ad6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/ips" status: 200 len: 152 microversion: 2.20 time: 0.037649 Aug 25 03:34:13.190772 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 556/1124] 10.222.0.58 () {60 vars in 1289 bytes} [Thu Aug 25 03:34:13 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:34:17.287351 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:17.290599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:17.296094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:17.296628 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:17.297059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:17.297737 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:17.298202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:17.298640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:17.322489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lazy-loading 'flavor' on Instance uuid e7d3cf80-7d6d-476e-8bdf-505e26458720 {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:34:17.754214 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-13b0f919-28dd-4421-966f-edb3122b42bd tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/action" status: 202 len: 0 microversion: 2.20 time: 0.470906 Aug 25 03:34:17.754842 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 569/1125] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Aug 25 03:34:17 2022] POST /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:34:17.763308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:17.763919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:17.770767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:17.771247 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:17.771685 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:17.772385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:17.773318 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:17.773747 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:17.953787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:17.962440 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:17.963974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:17.965127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-e5406faf-eb7b-457c-b98b-64ba4a5ec423 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.206036 Aug 25 03:34:17.965682 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 557/1126] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:17 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:18.989453 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:18.990144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:18.997831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:18.998340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:18.998779 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:18.999470 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:18.999915 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:19.000336 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:19.125373 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:19.133614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:19.135144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:19.136370 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-594aca10-9a59-45f5-8ee3-0ae4a9acc1c9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.151712 Aug 25 03:34:19.136927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 570/1127] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:18 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:20.159142 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:20.159748 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:20.166376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:20.166916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:20.167475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:20.168164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:20.168643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:20.169063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:20.312824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:20.321014 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:20.322552 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:20.323721 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a621bf59-6082-45f1-8013-c613f44e8eb6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.168593 Aug 25 03:34:20.324286 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 558/1128] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:20 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:21.377863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:21.377863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:21.377863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:21.377863 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:21.378919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:21.378919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:21.378919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:21.378919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:21.493868 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:21.502022 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:21.503566 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:21.504733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f599ddf3-2c1e-4244-aecc-b75e07ea78a6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.160349 Aug 25 03:34:21.505292 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 571/1129] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:21 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:22.528887 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:22.529449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:22.535707 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:22.536178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:22.536602 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:22.537273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:22.537710 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:22.538130 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:22.667868 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:22.676049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:22.677551 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:22.678736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d25a5b12-4de8-4af5-ac9f-5286e960f6f9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.153883 Aug 25 03:34:22.679296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 559/1130] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:22 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:23.701519 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:23.702169 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:23.708649 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:23.709137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:23.709573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:23.710267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:23.711227 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:23.711734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:23.740805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1435260375", "imageRef": "d1fe9de4-002e-4f61-88c3-34cb67dd6e13", "flavorRef": "452", "networks": [{"uuid": "c43ef05b-fb83-4731-af94-56b52e4a40c9"}]}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:23.795264 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] validate_networks() for [('c43ef05b-fb83-4731-af94-56b52e4a40c9', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:34:23.899299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:23.908696 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:23.911648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:23.913824 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-da9be5bd-3ed5-4dbf-bb52-a5a34589505d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.215875 Aug 25 03:34:23.915523 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 572/1131] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:23 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:24.421829 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:34:24.422243 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:34:24.422739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:34:24.423137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:34:24.423539 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:34:24.432907 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:24.433373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:24.433798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:24.434538 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:24.434983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:24.435397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:24.452273 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Getting quotas for project 0b8107c0e697482ea144a7026a568ff3. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:34:24.456277 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Getting quotas for user 43d7031613814c0eb40662b3b893bd49 and project 0b8107c0e697482ea144a7026a568ff3. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:34:24.467253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:34:24.469548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1fe9de4-002e-4f61-88c3-34cb67dd6e13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:34:24.563781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7fc504e2-0f30-4237-9433-95a32abfa4fd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826654 Aug 25 03:34:24.564438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 560/1132] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:34:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:34:24.576613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4f6f5936-008f-4a88-89c5-2498f88ef537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:24.580684 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4f6f5936-008f-4a88-89c5-2498f88ef537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:24.637184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4f6f5936-008f-4a88-89c5-2498f88ef537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:24.644489 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4f6f5936-008f-4a88-89c5-2498f88ef537 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1219 microversion: 2.1 time: 0.071859 Aug 25 03:34:24.645172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 573/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:24 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:34:24.939299 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:24.939941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:24.946810 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:24.952487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:24.952487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:24.952487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:24.952487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:24.952858 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:25.092171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:25.100298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:25.102327 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:25.103625 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bc97386e-0b98-4df5-873f-9d3e8615decc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.168263 Aug 25 03:34:25.104174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 561/1134] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:24 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:25.665457 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:25.666066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:25.675663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:25.676144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:25.676576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:25.677267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:25.677714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:25.678193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:25.749064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:25.756741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0230f7f1-a693-4c7c-ba46-812fba8ec5ee tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1223 microversion: 2.1 time: 0.095697 Aug 25 03:34:25.757310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 574/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:25 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:26.127089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:26.127659 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:26.134900 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:26.135386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:26.135822 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:26.136511 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:26.136963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:26.137387 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:26.266870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:26.274881 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:26.277223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:26.277593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ccc5776f-4f24-4a5f-a4d5-2471592bc6c8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.154575 Aug 25 03:34:26.278158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 562/1136] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:26 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:26.778064 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:26.778831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:26.785312 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:26.785775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:26.786206 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:26.786982 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:26.787415 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:26.787829 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:26.865660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:26.873624 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bc721b09-a067-41d2-bd41-8ac523928680 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1277 microversion: 2.1 time: 0.100252 Aug 25 03:34:26.874195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 575/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:26 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:27.301164 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:27.301722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:27.309210 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:27.309689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:27.310121 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:27.310847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:27.311296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:27.311716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:27.524134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:27.532456 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:27.534000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:27.535193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-12b281f3-3c71-4656-8dee-46d6ce9e171c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.238139 Aug 25 03:34:27.535819 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 563/1138] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:27 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:27.903621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:27.904298 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:27.911301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:27.911780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:27.912211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:27.912910 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:27.913364 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:27.913790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:28.100210 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:28.106870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f2ef75e2-d53a-4584-871d-bc40ec56a214 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.207240 Aug 25 03:34:28.107444 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 576/1139] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:27 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:28.150916 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-b1b84523-b950-43fc-b086-ad1bb1374e24 req-a65d34a2-479e-4d0a-b885-9f8da7432002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7fa6162-722f-49aa-99ce-8472d6f76e68", "tag": "00916461-314c-46ee-8a52-21f80c81e2c9"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:28.161971 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-b1b84523-b950-43fc-b086-ad1bb1374e24 req-a65d34a2-479e-4d0a-b885-9f8da7432002 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:28.162467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-b1b84523-b950-43fc-b086-ad1bb1374e24 req-a65d34a2-479e-4d0a-b885-9f8da7432002 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:28.162896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-b1b84523-b950-43fc-b086-ad1bb1374e24 req-a65d34a2-479e-4d0a-b885-9f8da7432002 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:28.174466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-b1b84523-b950-43fc-b086-ad1bb1374e24 req-a65d34a2-479e-4d0a-b885-9f8da7432002 service nova] Creating event network-changed:00916461-314c-46ee-8a52-21f80c81e2c9 for instance c7fa6162-722f-49aa-99ce-8472d6f76e68 on hv-cinder-85164 Aug 25 03:34:28.179541 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-b1b84523-b950-43fc-b086-ad1bb1374e24 req-a65d34a2-479e-4d0a-b885-9f8da7432002 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033568 Aug 25 03:34:28.180303 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 564/1140] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:34:28.558308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:28.558927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:28.565020 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:28.565498 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:28.565930 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:28.566807 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:28.567257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:28.567678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:28.781891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:28.790310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:28.791809 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:28.793013 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-07726af5-7b24-48f1-a93f-5fc5e0c241bc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.238954 Aug 25 03:34:28.793573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 577/1141] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:28 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:29.128615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:29.129302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:29.136400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:29.136873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:29.137293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:29.137966 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:29.138429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:29.138841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:29.270612 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:29.278181 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-7ff7cf0a-fe38-41e2-9281-b2e5731c03aa tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.153845 Aug 25 03:34:29.278782 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 565/1142] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:29 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:29.816721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:29.817329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:29.823813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:29.824293 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:29.824729 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:29.825417 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:29.825871 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:29.826308 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:29.955156 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:29.963946 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:29.965523 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:29.966732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2f7bf141-1280-4476-a8ab-3306f4d6a870 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.153976 Aug 25 03:34:29.970578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 578/1143] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:29 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:30.299706 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:30.300252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:30.306664 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:30.307408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:30.307847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:30.308535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:30.308989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:30.309411 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:30.437310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:30.444875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-04810997-cf60-405b-9c41-238e98cde4b1 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.149475 Aug 25 03:34:30.445451 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 566/1144] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:30 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:30.990147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:30.990781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:30.997803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:30.998298 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:30.998742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:30.999426 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:30.999873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:31.000294 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:31.128302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:31.136375 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:31.137891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:31.139096 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b01e07bf-c71c-42df-b872-71fd8c8a90f4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.152845 Aug 25 03:34:31.139665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 579/1145] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:30 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:31.467971 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:31.468585 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:31.475028 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:31.475505 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:31.475932 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:31.476616 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:31.477064 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:31.477481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:31.696145 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:31.696145 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-824fa7e0-a820-4df7-a6ea-bc705c561d5d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.150972 Aug 25 03:34:31.696145 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 567/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:31 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:32.162454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:32.163067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:32.170309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:32.171053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:32.171495 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:32.172464 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:32.173192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:32.173622 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:32.192522 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:32.312804 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:32.321059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:32.322596 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:32.323755 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-92a2c26c-5cd3-4dac-9310-7b553ba0da8d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.165297 Aug 25 03:34:32.324310 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 580/1147] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:32 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:32.633101 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:32.633866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:32.640316 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:32.640796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:32.641234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:32.641929 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:32.642439 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:32.642863 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:32.774492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:32.782466 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-87e4b9e7-dfff-4209-acb8-f0f962390e9a tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.153304 Aug 25 03:34:32.783035 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 568/1148] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:32 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:33.346008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:33.346640 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:33.353619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:33.354186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:33.354657 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:33.355384 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:33.355835 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:33.356254 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:33.481739 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:33.489921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:33.491461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:33.492633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a71f7dc7-3379-4f0f-ad59-c48c60315bc3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.150515 Aug 25 03:34:33.493187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 581/1149] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:33 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:33.803550 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:33.804163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:33.811481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:33.811960 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:33.812397 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:33.813117 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:33.813575 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:33.814001 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:33.946046 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:33.953736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ce773962-f45b-410e-bdaf-ceaf577ce7ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.154093 Aug 25 03:34:33.954323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 569/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:33 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:34.090338 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-6ae7cde1-84bf-4996-a2f2-15973ef84ae5 req-afeca38e-63c9-4752-b25a-c85cb3f1956b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fa6162-722f-49aa-99ce-8472d6f76e68", "name": "network-vif-plugged", "status": "completed", "tag": "00916461-314c-46ee-8a52-21f80c81e2c9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:34.100630 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-6ae7cde1-84bf-4996-a2f2-15973ef84ae5 req-afeca38e-63c9-4752-b25a-c85cb3f1956b service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:34.101270 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-6ae7cde1-84bf-4996-a2f2-15973ef84ae5 req-afeca38e-63c9-4752-b25a-c85cb3f1956b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:34.101697 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-6ae7cde1-84bf-4996-a2f2-15973ef84ae5 req-afeca38e-63c9-4752-b25a-c85cb3f1956b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:34.115859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-6ae7cde1-84bf-4996-a2f2-15973ef84ae5 req-afeca38e-63c9-4752-b25a-c85cb3f1956b service nova] Creating event network-vif-plugged:00916461-314c-46ee-8a52-21f80c81e2c9 for instance c7fa6162-722f-49aa-99ce-8472d6f76e68 on hv-cinder-85164 Aug 25 03:34:34.123936 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-6ae7cde1-84bf-4996-a2f2-15973ef84ae5 req-afeca38e-63c9-4752-b25a-c85cb3f1956b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037198 Aug 25 03:34:34.124540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 582/1151] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:34:34.516157 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:34.516765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:34.518735 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:34.519394 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:34.524030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:34.524660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:34.525618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:34.526328 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:34.526781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:34.527202 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:34.531257 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:34.673415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:34.681540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:34.686400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:34.686400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-00ac8e36-4c56-4d71-922d-0a3512674302 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1745 microversion: 2.20 time: 0.172374 Aug 25 03:34:34.686400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 570/1152] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:34 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:34.975216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:34.975912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:34.978357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:34.979084 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=39 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:34.983781 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:34.984252 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:34.984680 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:34.985359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:34.985803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:34.986225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:35.113919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:35.122112 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a4a29e4f-f542-4185-820f-21ce1ab74773 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.151104 Aug 25 03:34:35.122709 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 583/1153] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:34 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:35.709094 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:35.709700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:35.717006 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:35.717488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:35.717921 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:35.718647 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:35.719099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:35.719520 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:35.850491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:35.859452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:35.861059 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:35.862254 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-654db9aa-3c5f-413e-834f-c2ab7fa82cba tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1745 microversion: 2.20 time: 0.157529 Aug 25 03:34:35.862900 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 571/1154] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:35 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:36.143450 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:36.144065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:36.151331 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:36.155953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:36.155953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:36.155953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:36.155953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:36.156329 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:36.284400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:36.292275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-6c042908-a999-49e5-a5a0-b4187d437b06 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1319 microversion: 2.1 time: 0.152909 Aug 25 03:34:36.292851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 584/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:36 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:36.885573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:36.886233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:36.892937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:36.893415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:36.893847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:36.894568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:36.895050 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:36.895470 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:37.029376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:37.037323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:37.038841 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:37.040645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-018d5bf0-1b08-4c53-bb32-044877d8af92 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1745 microversion: 2.20 time: 0.158705 Aug 25 03:34:37.041205 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 572/1156] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:36 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:37.313434 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:37.314040 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:37.320371 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:37.321000 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:37.321427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:37.322104 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:37.322569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:37.322989 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:37.453191 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:37.460897 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-2aafca79-4a60-4ade-b128-0d1ce5d95dbb tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1508 microversion: 2.1 time: 0.151323 Aug 25 03:34:37.461468 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 585/1157] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:34:37 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:34:37.482377 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8b28276-8808-4b16-8b36-754f8d0c0c90", "device": "/dev/sdb"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:37.484792 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:37.486643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:34:37.491225 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:37.491689 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:37.492114 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:37.492812 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:37.493655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:37.494074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:38.064037 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:38.064663 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:38.072239 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:38.072712 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:38.073201 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:38.073890 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:38.074357 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:38.074774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:38.212654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:38.221634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:38.222189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-551f26b6-8127-4231-b2b8-50f0f42c5356 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "POST /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744257 Aug 25 03:34:38.228256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 573/1158] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 25 03:34:37 2022] POST /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:34:38.228438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:38.228438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-21d2a5d0-f997-4694-9df1-9d678cab86d9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1745 microversion: 2.20 time: 0.164712 Aug 25 03:34:38.228438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 586/1159] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:38 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:38.231390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-7f8437f4-7205-473a-8b63-f277d199eac0 req-3339cb65-83ab-4690-ad72-832ca717bd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3cf80-7d6d-476e-8bdf-505e26458720", "name": "network-vif-plugged", "status": "completed", "tag": "c4e50523-60cc-43ab-a3c5-8e6094960565"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:38.241731 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7f8437f4-7205-473a-8b63-f277d199eac0 req-3339cb65-83ab-4690-ad72-832ca717bd8b service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:38.242212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7f8437f4-7205-473a-8b63-f277d199eac0 req-3339cb65-83ab-4690-ad72-832ca717bd8b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:38.242681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-7f8437f4-7205-473a-8b63-f277d199eac0 req-3339cb65-83ab-4690-ad72-832ca717bd8b service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:38.254737 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-7f8437f4-7205-473a-8b63-f277d199eac0 req-3339cb65-83ab-4690-ad72-832ca717bd8b service nova] Creating event network-vif-plugged:c4e50523-60cc-43ab-a3c5-8e6094960565 for instance e7d3cf80-7d6d-476e-8bdf-505e26458720 on hv-cinder-85164 Aug 25 03:34:38.260512 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-7f8437f4-7205-473a-8b63-f277d199eac0 req-3339cb65-83ab-4690-ad72-832ca717bd8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036080 Aug 25 03:34:38.261276 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 574/1160] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:34:39.247388 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:39.247995 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:39.254494 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:39.254971 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:39.255401 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:39.256087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:39.256534 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:39.256956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:39.397232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:39.409491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:39.411980 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:39.413757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-57fa1a26-c410-4b2f-b3b2-f69e42cb6892 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1745 microversion: 2.20 time: 0.170174 Aug 25 03:34:39.414629 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 587/1161] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:39 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:40.445755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:40.446487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:40.452545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:40.453032 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:40.453465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:40.454169 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:40.454643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:40.455069 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:40.587150 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:40.597071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:40.599463 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:40.600854 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2d358a60-a6e6-418c-9bb1-5e2db298e848 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.159808 Aug 25 03:34:40.601410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 575/1162] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:40 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:41.629952 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:41.631269 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:41.638837 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:41.639521 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:41.640018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:41.640728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:41.641173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:41.641591 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:41.779641 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:41.788629 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:41.790121 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:41.791349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-1055f2d1-4701-4c7c-a323-5e88838baec6 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.165413 Aug 25 03:34:41.791934 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 588/1163] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:41 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:42.815532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:42.816086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:42.822803 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:42.823587 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:42.824245 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:42.825185 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:42.825847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:42.826520 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:42.963373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:42.973163 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:42.974717 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:42.975897 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d15887ad-7b5f-4f23-b7e4-48cb48253955 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.164433 Aug 25 03:34:42.990453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 576/1164] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:42 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:44.000217 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:44.000949 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:44.007446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:44.007921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:44.008350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:44.009257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:44.010365 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:44.010792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:44.140736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:44.149157 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:44.150733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:44.151886 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e15b82a8-5018-431e-b81d-0eb019edee4f tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.155597 Aug 25 03:34:44.152445 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 589/1165] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:43 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:45.175338 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:45.175908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:45.183019 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:45.183598 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:45.184053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:45.184767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:45.185221 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:45.185646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:45.349934 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:45.358962 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:45.360591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:45.361892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-28b40616-45d2-4554-a0f2-0af82b03ac93 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.190720 Aug 25 03:34:45.362560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 577/1166] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:45 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:46.387445 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:46.389066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:46.396184 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:46.396884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:46.397621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:46.399147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:46.399147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:46.399621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:46.551105 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:46.559676 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:46.561225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:46.562648 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-b48eccd0-c320-43b6-91c5-babb75aa7ea5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.179406 Aug 25 03:34:46.563409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 590/1167] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:46 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:47.588876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:47.589761 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:47.596487 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:47.597053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:47.597580 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:47.598379 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:47.599048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:47.599669 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:47.760609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:47.770192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:47.771720 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:47.773217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ee7cb66b-5715-40d3-8101-4316be6887b4 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.189742 Aug 25 03:34:47.774119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 578/1168] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:47 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:48.800467 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:48.801086 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:48.809195 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:48.809682 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:48.810127 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:48.810851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:48.811542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:48.812189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:48.949178 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:48.958904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:48.960653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:48.962017 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-cb7af8c1-9736-4ef3-8e94-1a2f00bd739d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.165493 Aug 25 03:34:48.978118 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 591/1169] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:48 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:49.985293 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:49.985901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:49.993475 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:49.994620 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:49.995243 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:49.996118 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:49.996705 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:49.997324 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:50.143370 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:50.152927 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:50.154495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:50.156820 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-85f10e01-b182-4bc2-8ce5-d856f8892048 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.175380 Aug 25 03:34:50.157401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 579/1170] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:49 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:51.180966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:51.181643 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:51.188418 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:51.188896 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:51.189334 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:51.190024 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:51.190511 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:51.190937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:51.330327 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:51.345954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:51.345954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:51.345954 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-db995241-43e0-494e-a758-58bdcdcc940d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.165040 Aug 25 03:34:51.346337 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 592/1171] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:51 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:34:52.363771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:52.364373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:52.370808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:52.371291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:52.371732 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:52.372425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:52.372873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:52.373298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:52.501653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:52.510535 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:52.512029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:52.513302 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-23241b28-487e-4e7b-b970-7d2d375e4ed2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1740 microversion: 2.20 time: 0.153287 Aug 25 03:34:52.513797 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 580/1172] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:52 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:53.536255 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:53.536884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:53.543827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:53.544304 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:53.544731 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:53.545421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:53.545871 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:53.546314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:53.691964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:53.691964 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:53.692212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:53.692212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a3d6fb6e-21da-4803-8345-fa9bee3dc0a3 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1722 microversion: 2.20 time: 0.159201 Aug 25 03:34:53.692212 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 593/1173] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:53 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:54.714913 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:54.716112 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:54.722304 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:54.722830 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:54.723268 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:54.723964 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:54.724415 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:54.724840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:54.860037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:54.868250 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:54.870429 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:54.871607 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-714d2eb3-398e-4b1d-b0a2-ac2ee7088333 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1722 microversion: 2.20 time: 0.160691 Aug 25 03:34:54.872186 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 581/1174] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:54 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:55.894533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:55.895072 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:55.901538 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:55.902045 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:55.902511 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:55.903203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:55.903656 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:55.904078 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:56.033175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:56.041338 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:56.042881 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:56.044037 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-8924f19c-01a5-4071-be61-f28c5012458b tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1722 microversion: 2.20 time: 0.153570 Aug 25 03:34:56.044592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 594/1175] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:55 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:57.067576 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:57.068183 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:57.075174 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:57.075651 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:57.076082 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:57.076774 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:57.077224 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:57.077659 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:57.220685 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-d799f6a1-a2ca-4451-ae72-02a32f023495 req-6e6f5354-b244-491e-b734-51cfd73f64d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3cf80-7d6d-476e-8bdf-505e26458720", "name": "network-vif-unplugged", "status": "completed", "tag": "c4e50523-60cc-43ab-a3c5-8e6094960565"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:57.237162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d799f6a1-a2ca-4451-ae72-02a32f023495 req-6e6f5354-b244-491e-b734-51cfd73f64d9 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:57.237162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d799f6a1-a2ca-4451-ae72-02a32f023495 req-6e6f5354-b244-491e-b734-51cfd73f64d9 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:57.237389 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:57.237525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-d799f6a1-a2ca-4451-ae72-02a32f023495 req-6e6f5354-b244-491e-b734-51cfd73f64d9 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:57.240479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:57.241970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:57.243311 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-40864782-43f3-40c0-9dde-26bcf34e09de tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1722 microversion: 2.20 time: 0.179677 Aug 25 03:34:57.243451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-d799f6a1-a2ca-4451-ae72-02a32f023495 req-6e6f5354-b244-491e-b734-51cfd73f64d9 service nova] Creating event network-vif-unplugged:c4e50523-60cc-43ab-a3c5-8e6094960565 for instance e7d3cf80-7d6d-476e-8bdf-505e26458720 on hv-cinder-85164 Aug 25 03:34:57.243985 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 582/1176] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:57 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:57.248506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-d799f6a1-a2ca-4451-ae72-02a32f023495 req-6e6f5354-b244-491e-b734-51cfd73f64d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031462 Aug 25 03:34:57.249091 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 595/1177] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:34:58.266274 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:58.266907 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:58.273540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:58.274011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:58.274474 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:58.275662 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:58.276108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:58.276529 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:58.402060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:58.410089 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:58.411659 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:58.412826 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d79474a7-c33d-4090-8319-546a8f728488 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1722 microversion: 2.20 time: 0.150496 Aug 25 03:34:58.413383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 583/1178] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:58 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:34:59.438903 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:34:59.439600 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:59.446043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:59.446561 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:59.446995 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:59.447682 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:59.448132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:59.448554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:59.579894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:59.588695 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:59.590203 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:34:59.591396 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d66521e2-9309-4a27-9a9a-bcd5655b8d1e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1725 microversion: 2.20 time: 0.157809 Aug 25 03:34:59.591956 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 596/1179] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:34:59 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:34:59.614244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1382791c-4a24-436a-bf57-0ee9c1b7d4e5"}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:34:59.616693 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:34:59.623118 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:59.623603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:59.624039 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:34:59.624742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:34:59.625202 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:34:59.625626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:00.247858 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:35:00.618206 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-71d75a4a-2f52-419a-9448-4d521324cea8 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.007974 Aug 25 03:35:00.619568 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 584/1180] 10.222.0.58 () {62 vars in 1364 bytes} [Thu Aug 25 03:34:59 2022] POST /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-volume_attachments => generated 188 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:35:00.741786 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:00.742274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:00.749241 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:00.749719 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:00.750152 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:00.750866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:00.751319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:00.751741 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:00.838461 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:35:01.299232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bcd38986-f220-4cfd-91cd-453cee88afd0 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-volume_attachments/1382791c-4a24-436a-bf57-0ee9c1b7d4e5" status: 202 len: 0 microversion: 2.20 time: 0.559382 Aug 25 03:35:01.299232 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 597/1181] 10.222.0.58 () {60 vars in 1457 bytes} [Thu Aug 25 03:35:00 2022] DELETE /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-volume_attachments/1382791c-4a24-436a-bf57-0ee9c1b7d4e5 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:35:01.358943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:35:01.359540 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:01.366049 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:01.366574 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:01.367013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:01.367702 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:01.368153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:01.368610 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:01.398896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121278) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 03:35:01.730605 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d24648ee-2380-430a-a56b-03a2ee7b0b36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "POST /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/action" status: 202 len: 0 microversion: 2.20 time: 0.375416 Aug 25 03:35:01.732070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 585/1182] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Aug 25 03:35:01 2022] POST /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:35:01.739469 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:01.740081 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:01.746435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:01.746926 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:01.747344 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:01.748085 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:01.748528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:01.748953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:01.879173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:01.888267 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:01.889892 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:01.891095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d0674f87-e14f-40f5-9057-a85199bf4f37 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1673 microversion: 2.20 time: 0.155654 Aug 25 03:35:01.891656 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 598/1183] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:01 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:35:02.348303 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:02.348793 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:02.355444 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:02.355925 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:02.356353 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:02.357038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:02.357483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:02.357899 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:02.441480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lazy-loading 'services' on Instance uuid c7fa6162-722f-49aa-99ce-8472d6f76e68 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:35:02.662592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2a9f5500-166c-47ed-bc7e-d079b0040994 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68/os-volume_attachments/b8b28276-8808-4b16-8b36-754f8d0c0c90" status: 202 len: 0 microversion: 2.1 time: 0.313850 Aug 25 03:35:02.662592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 586/1184] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 25 03:35:02 2022] DELETE /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68/os-volume_attachments/b8b28276-8808-4b16-8b36-754f8d0c0c90 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:35:02.913128 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:02.913745 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:02.925341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:02.925341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:02.925341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:02.925341 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:02.925714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:02.925714 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:03.052363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:03.060973 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:03.062594 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:03.063743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-807eb795-be88-42e2-a873-0e126c5edaa2 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1673 microversion: 2.20 time: 0.154585 Aug 25 03:35:03.064301 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 599/1185] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:02 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:04.090047 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:04.090677 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:04.096970 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:04.097482 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:04.097918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:04.098635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:04.099105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:04.099506 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:04.323512 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:04.331602 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:04.333165 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:04.334342 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-cd42599c-e8ec-4111-8f1d-ea4deab55441 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.249718 Aug 25 03:35:04.334906 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 587/1186] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:04 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:04.835032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:04.835516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:04.843021 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:04.843613 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:04.844166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:04.844937 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:04.845541 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:04.845962 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:04.872451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:35:05.040919 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=36 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:35:05.118501 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-ca63283b-a933-4d6b-b0f3-76303328742f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 204 len: 0 microversion: 2.1 time: 0.286884 Aug 25 03:35:05.128614 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 600/1187] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:35:04 2022] DELETE /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:35:05.128767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:05.128767 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:05.135578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:05.136280 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:05.136716 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:05.137408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:05.137860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:05.138298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:05.266256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:05.274138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b04ecf21-3e0e-4f16-bdc5-276f7770a47f tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.150058 Aug 25 03:35:05.274690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 588/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:05 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:05.358749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:05.359444 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:05.365427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:05.365918 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:05.366356 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:05.367041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:05.367486 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:05.368070 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:05.496257 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:05.504352 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:05.505873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:05.507066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-830b38ae-2d89-4ac7-b298-bc82368c0049 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.152479 Aug 25 03:35:05.507633 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 601/1189] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:05 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:06.295013 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:06.295628 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:06.302011 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:06.302527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:06.302965 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:06.303655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:06.304107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:06.304653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:06.434994 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:06.442655 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-061d2891-b7ce-4c14-b956-def781ef12cd tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.151483 Aug 25 03:35:06.443229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 589/1190] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:06 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:35:06.530033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:06.530671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:06.538016 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:06.538811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:06.539478 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:06.540571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:06.541275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:06.541715 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:06.675118 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:06.684002 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:06.688548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:06.688548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-a6ce338f-a874-4a8c-8d46-9b9fa383fd81 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.161499 Aug 25 03:35:06.688548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 602/1191] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:06 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:07.464404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:07.465144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:07.472301 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:07.472835 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:07.473549 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:07.474310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:07.474902 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:07.475322 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:07.624017 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:07.633036 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-817f616f-a865-411c-854f-ea806bf0e6e0 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.172671 Aug 25 03:35:07.642901 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 590/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:07 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:07.710528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:07.711435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:07.718352 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:07.719134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:07.719636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:07.720427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:07.720942 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:07.721458 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:07.864665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:07.874523 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:07.876153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:07.877394 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-37093c66-f995-41fa-9439-65c1af657067 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.170866 Aug 25 03:35:07.878033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 603/1193] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:07 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:08.654192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:08.654857 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:08.657330 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:35:08.662376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:08.662823 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:08.679629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:08.679629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:08.679629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:08.679629 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:08.803510 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:08.812448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-aef89d0b-a52e-4438-8ab7-826905720f36 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.162071 Aug 25 03:35:08.813401 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 591/1194] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:08 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:08.901160 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:08.902012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:08.908808 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:08.909314 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:08.909736 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:08.910490 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:08.911040 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:08.911517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:09.055912 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:09.065066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:09.066582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:09.067751 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d2ea23c0-1166-4736-be69-82311de25efc tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.170676 Aug 25 03:35:09.074691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 604/1195] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:08 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:09.835282 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:09.836099 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:09.843917 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:09.844352 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:09.844793 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:09.845532 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:09.846017 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:09.846467 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:09.991609 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:10.000751 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-fd8eb9d0-06c9-4bc5-afde-8ea62ea237c3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.169281 Aug 25 03:35:10.001343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 592/1196] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:09 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:10.091355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:10.092580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:10.099813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:10.100292 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:10.100730 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:10.101433 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:10.101884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:10.102326 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:10.241381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:10.255578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:10.258922 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:10.261595 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7d49f1d5-8632-4dcc-9b0f-808df3839079 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.174440 Aug 25 03:35:10.262659 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 605/1197] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:10 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:11.022114 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:11.022734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:11.029955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:11.030471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:11.030904 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:11.031598 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:11.032045 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:11.032459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:11.183270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:11.183270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-de3ad704-c570-44ff-99be-9b40a5bd9f83 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.164468 Aug 25 03:35:11.186643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 593/1198] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:11 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:11.288526 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:11.290154 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:11.298254 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:11.299211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:11.300052 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:11.301192 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:11.302055 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:11.302847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:11.360437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-3623e1dd-d6a5-409c-acb9-4480d2f7fda2 req-89502fbd-a2d4-4a3c-b78e-454bff1b0a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fa6162-722f-49aa-99ce-8472d6f76e68", "name": "network-vif-unplugged", "status": "completed", "tag": "00916461-314c-46ee-8a52-21f80c81e2c9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:35:11.382911 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3623e1dd-d6a5-409c-acb9-4480d2f7fda2 req-89502fbd-a2d4-4a3c-b78e-454bff1b0a8f service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:11.383406 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3623e1dd-d6a5-409c-acb9-4480d2f7fda2 req-89502fbd-a2d4-4a3c-b78e-454bff1b0a8f service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:11.383842 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-3623e1dd-d6a5-409c-acb9-4480d2f7fda2 req-89502fbd-a2d4-4a3c-b78e-454bff1b0a8f service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:11.399001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-3623e1dd-d6a5-409c-acb9-4480d2f7fda2 req-89502fbd-a2d4-4a3c-b78e-454bff1b0a8f service nova] Creating event network-vif-unplugged:00916461-314c-46ee-8a52-21f80c81e2c9 for instance c7fa6162-722f-49aa-99ce-8472d6f76e68 on hv-cinder-85164 Aug 25 03:35:11.404619 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-3623e1dd-d6a5-409c-acb9-4480d2f7fda2 req-89502fbd-a2d4-4a3c-b78e-454bff1b0a8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123550 Aug 25 03:35:11.405537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 606/1199] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:35:11.479559 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:11.502111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:11.503914 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:11.505176 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-be4cabe1-6034-4dbc-ab57-0c946b8a25a5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.223035 Aug 25 03:35:11.505382 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 594/1200] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:11 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:35:12.207083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:12.207793 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:12.214168 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:12.214678 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:12.215115 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:12.215813 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:12.216264 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:12.216686 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:12.365662 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:12.373792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d1061fbb-786b-4dba-91ab-ed912b0993e8 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.170855 Aug 25 03:35:12.374752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 607/1201] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:12 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:12.529844 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:12.530490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:12.537624 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:12.538446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:12.539100 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:12.539937 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:12.540593 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:12.541060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:12.719986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:12.730412 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:12.730658 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:12.731784 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d84c6180-b63d-4af8-b000-c5ee427f7d9a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.207247 Aug 25 03:35:12.732350 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 595/1202] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:12 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:13.396208 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:13.397141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:13.404056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:13.404605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:13.405157 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:13.405858 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:13.406330 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:13.406784 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:13.550317 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:13.559100 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-dc84d33a-dcc9-47b9-a5e2-0a9f9e17d7f4 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.166812 Aug 25 03:35:13.559884 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 608/1203] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:13 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:13.755572 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:13.756188 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:13.762662 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:13.763149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:13.763581 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:13.764284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:13.764736 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:13.765160 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:13.908787 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:13.917615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:13.919152 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:13.920319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5e8384bd-99ff-49c8-882a-22239a806b3e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.168928 Aug 25 03:35:13.920954 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 596/1204] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:13 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:14.580406 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:14.581067 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:14.587747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:14.588734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:14.589335 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:14.590036 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:14.590509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:14.590929 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:14.730144 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:14.737974 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-f8d44218-44d2-47bd-ba5d-0186e554b657 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.161568 Aug 25 03:35:14.738579 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 609/1205] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:14 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:14.944963 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:14.945572 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:14.952597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:14.953024 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:14.953453 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:14.954138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:14.954611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:14.955039 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:15.086074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:15.094882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:15.096395 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:15.097560 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-2d12b7c4-1be2-4ada-ba02-79c754e43a88 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.156513 Aug 25 03:35:15.098119 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 597/1206] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:14 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:15.759346 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:15.759991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:15.766560 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:15.767041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:15.767476 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:15.768166 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:15.768618 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:15.769049 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:15.897967 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:15.905880 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5ef42285-74a4-42ab-bbda-bf62f10cb3ff tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.150480 Aug 25 03:35:15.906563 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 610/1207] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:15 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:16.120077 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:16.120684 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:16.127029 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:16.127507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:16.127940 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:16.128619 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:16.129066 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:16.129488 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:16.147026 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:35:16.260304 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:16.268383 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:16.269998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:16.271171 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-684d618f-bd04-48df-9e9c-8d2998ca295c tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.155030 Aug 25 03:35:16.271731 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 598/1208] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:16 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:16.926749 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:16.927353 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:16.934689 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:16.935162 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:16.935687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:16.936362 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:16.936803 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:16.937216 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:17.063186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:17.065499 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:35:17.071627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-289adba4-209b-49d8-8b2a-a4619bd0bcf7 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.148737 Aug 25 03:35:17.072207 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 611/1209] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:16 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:17.295951 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:17.296578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:17.303177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:17.303660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:17.304095 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:17.304883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:17.305333 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:17.305758 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:17.435623 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:17.443700 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:17.445380 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:17.446586 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-14fc09ab-9f89-4f4d-9467-b83af3c92c50 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.155023 Aug 25 03:35:17.447146 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 599/1210] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:17 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:18.093516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:18.094134 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:18.101626 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:18.102110 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:18.102575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:18.103276 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:18.103732 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:18.104159 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:18.243765 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:18.251539 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e06a35e-52e7-4b7b-8cb2-698f2d079fe3 tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1514 microversion: 2.1 time: 0.161893 Aug 25 03:35:18.252117 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 612/1211] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:18 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:18.469385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:18.479251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:18.479251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:18.479251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:18.479251 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:18.479724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:18.479724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:18.479724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:18.613969 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:18.622636 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:18.624149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:18.625318 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4c0f245f-dd76-4ba9-bdb2-ebc27392d9eb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.160085 Aug 25 03:35:18.625882 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 600/1212] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:18 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:18.908087 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-4b04403d-888c-4fe6-94b1-1a0e43515fa3 req-c3ed25cb-1412-4432-ad35-58138bc2a1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fa6162-722f-49aa-99ce-8472d6f76e68", "name": "network-vif-deleted", "tag": "00916461-314c-46ee-8a52-21f80c81e2c9"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:35:18.917893 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b04403d-888c-4fe6-94b1-1a0e43515fa3 req-c3ed25cb-1412-4432-ad35-58138bc2a1ed service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:18.918386 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b04403d-888c-4fe6-94b1-1a0e43515fa3 req-c3ed25cb-1412-4432-ad35-58138bc2a1ed service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:18.918816 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-4b04403d-888c-4fe6-94b1-1a0e43515fa3 req-c3ed25cb-1412-4432-ad35-58138bc2a1ed service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:18.930060 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-4b04403d-888c-4fe6-94b1-1a0e43515fa3 req-c3ed25cb-1412-4432-ad35-58138bc2a1ed service nova] Creating event network-vif-deleted:00916461-314c-46ee-8a52-21f80c81e2c9 for instance c7fa6162-722f-49aa-99ce-8472d6f76e68 on hv-cinder-85164 Aug 25 03:35:18.935992 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-4b04403d-888c-4fe6-94b1-1a0e43515fa3 req-c3ed25cb-1412-4432-ad35-58138bc2a1ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084190 Aug 25 03:35:18.936577 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 613/1213] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:35:19.272883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:19.273489 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:19.279545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:19.280024 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:19.280455 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:19.281140 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:19.281588 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:19.282018 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:19.346229 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:19.354253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-821d2f8e-e556-487e-8975-5b1b2e46569c tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1472 microversion: 2.1 time: 0.085219 Aug 25 03:35:19.354847 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 601/1214] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:19 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:19.654145 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:19.654866 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:19.661400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:19.661867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:19.662307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:19.662997 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:19.663439 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:19.663854 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:19.835872 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:19.845079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:19.846582 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:19.847891 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3e0fc98f-1a3d-41dd-82a7-e2ef61336d0d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.198595 Aug 25 03:35:19.848380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 614/1215] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:19 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:20.376153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:20.376893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:20.383517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:20.386479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:20.386479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:20.386479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:20.386479 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:20.386879 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:20.418491 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:20.418972 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:20.419410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:20.419864 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.objects.instance [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lazy-loading 'fault' on Instance uuid c7fa6162-722f-49aa-99ce-8472d6f76e68 {{(pid=121278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:35:20.492067 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d7031613814c0eb40662b3b893bd49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8107c0e697482ea144a7026a568ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:20.500961 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-321faf24-0b0b-4c5a-a081-acb24418104d tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 200 len: 1309 microversion: 2.1 time: 0.128947 Aug 25 03:35:20.501546 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 602/1216] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:20 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:35:20.871921 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:20.872536 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:20.879687 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:20.880163 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:20.880611 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:20.881295 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:20.881742 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:20.882161 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:21.016058 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:21.024229 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:21.026376 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:21.027551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0a9a63f9-0381-4792-91b7-4347634edc7a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.159540 Aug 25 03:35:21.028103 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 615/1217] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:20 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:21.522008 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:21.522656 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] [instance: c7fa6162-722f-49aa-99ce-8472d6f76e68] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:21.529550 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:21.530031 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:21.530500 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:21.531200 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:21.531678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:21.532104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:21.545137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] HTTP exception thrown: Instance c7fa6162-722f-49aa-99ce-8472d6f76e68 could not be found. Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Request method failure captured: Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 HTTP/1.1 Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBu1oCtGY8BUMldyhFWlnNNOMijZtnPbcQLgakqRq07L1ysFATyktO1qOniNVyx15djt6Ze1InZv8HISdyD1cMoPIU128jtMoRNf1nNrLIBekf6jYTGt8A19jFPBUOTysUMlmQy0OlSlZIDbHxHu3tl_tkHWeovKh_ubXbW5r2w0TuQY Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 0b8107c0e697482ea144a7026a568ff3 Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-VolumesSnapshotTestJSON-323951136 Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:35:21.546806 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b8107c0e697482ea144a7026a568ff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b8107c0e697482ea144a7026a568ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b8107c0e697482ea144a7026a568ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b8107c0e697482ea144a7026a568ff3"}]}] Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-VolumesSnapshotTestJSON-323951136 Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 0b8107c0e697482ea144a7026a568ff3 Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-323951136 Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-VolumesSnapshotTestJSON-323951136-project Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 43d7031613814c0eb40662b3b893bd49 Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-VolumesSnapshotTestJSON-323951136-project Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance c7fa6162-722f-49aa-99ce-8472d6f76e68 could not be found. Aug 25 03:35:21.548680 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'c7fa6162-722f-49aa-99ce-8472d6f76e68'} Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7fa6162-722f-49aa-99ce-8472d6f76e68 could not be found. Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:35:21.549672 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7fa6162-722f-49aa-99ce-8472d6f76e68 could not be found. Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7fa6162-722f-49aa-99ce-8472d6f76e68 could not be found. Aug 25 03:35:21.551366 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:35:21.552838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] Returning 404 to user: Instance c7fa6162-722f-49aa-99ce-8472d6f76e68 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:35:21.552838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9c51918d-770d-4364-a75b-2d44bda9b4ec tempest-VolumesSnapshotTestJSON-323951136 tempest-VolumesSnapshotTestJSON-323951136-project] 10.222.0.58 "GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68" status: 404 len: 111 microversion: 2.1 time: 0.030129 Aug 25 03:35:21.552838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 603/1218] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:35:21 2022] GET /compute/v2.1/servers/c7fa6162-722f-49aa-99ce-8472d6f76e68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:35:22.050572 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:22.051117 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:22.058414 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:22.058889 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:22.059319 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:22.060001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:22.060446 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:22.060864 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:22.193548 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:22.201833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:22.203363 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:22.204529 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-84cf5305-755e-46c3-a20d-6256020de8be tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.158026 Aug 25 03:35:22.205094 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 616/1219] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:22 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:23.227923 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:23.233218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:23.236226 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:23.236911 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:23.237522 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:23.238438 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:23.238886 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:23.239495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:23.373496 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:23.377632 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-9d1ab5a2-efa6-478c-8c64-80b9db64aff5 req-106d95c1-1ae2-4fd5-8869-edfabdec0768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3cf80-7d6d-476e-8bdf-505e26458720", "name": "network-vif-plugged", "status": "completed", "tag": "c4e50523-60cc-43ab-a3c5-8e6094960565"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:35:23.382584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:23.384065 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:23.385249 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-44c0d38d-a821-46f1-9102-4e46bf3fb1fe tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.161229 Aug 25 03:35:23.385817 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 604/1220] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:23 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:23.387597 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-9d1ab5a2-efa6-478c-8c64-80b9db64aff5 req-106d95c1-1ae2-4fd5-8869-edfabdec0768 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:23.388007 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-9d1ab5a2-efa6-478c-8c64-80b9db64aff5 req-106d95c1-1ae2-4fd5-8869-edfabdec0768 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:23.388431 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-9d1ab5a2-efa6-478c-8c64-80b9db64aff5 req-106d95c1-1ae2-4fd5-8869-edfabdec0768 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:23.399377 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-9d1ab5a2-efa6-478c-8c64-80b9db64aff5 req-106d95c1-1ae2-4fd5-8869-edfabdec0768 service nova] Creating event network-vif-plugged:c4e50523-60cc-43ab-a3c5-8e6094960565 for instance e7d3cf80-7d6d-476e-8bdf-505e26458720 on hv-cinder-85164 Aug 25 03:35:23.404147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-9d1ab5a2-efa6-478c-8c64-80b9db64aff5 req-106d95c1-1ae2-4fd5-8869-edfabdec0768 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030232 Aug 25 03:35:23.404721 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 617/1221] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:35:24.408426 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:24.409131 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:24.415447 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:24.415928 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:24.416365 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:24.417060 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:24.417511 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:24.417938 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:24.543918 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:24.552070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:24.553578 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:24.554771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4c1c5d66-a1d4-448f-ac0f-9e7d683de1d7 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.150339 Aug 25 03:35:24.555341 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 605/1222] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:24 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:25.580030 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:25.580734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:25.586932 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:25.587412 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:25.587850 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:25.589204 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:25.589655 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:25.590080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:25.728802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:25.736914 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:25.738427 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:25.739578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-4d971ae9-ae12-4494-8cd2-43c652dc2231 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.164431 Aug 25 03:35:25.740143 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 618/1223] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:25 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:26.762671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:26.763284 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:26.769804 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:26.770311 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:26.770750 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:26.771448 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:26.771900 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:26.772326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:26.899814 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:26.908474 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:26.909979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:26.911170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-09c106ff-6994-41fc-ad09-64f5656bf9bb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.152505 Aug 25 03:35:26.911734 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 606/1224] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:26 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:27.935539 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:27.939556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:27.942909 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:27.943400 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:27.943833 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:27.944557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:27.945005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:27.945509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:28.072431 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:28.080521 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:28.082035 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:28.083225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-fbb26918-87f6-4247-898b-2d10af26ac15 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.152544 Aug 25 03:35:28.083792 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 619/1225] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:27 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:29.107459 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:29.108070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:29.114711 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:29.115186 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:29.115621 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:29.116313 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:29.116762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:29.117184 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:29.258252 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:29.273465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:29.273465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:29.273465 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-828b4576-1eb7-4b95-b2b2-c085bc5a4acb tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.168275 Aug 25 03:35:29.274218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 607/1226] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:29 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:30.294637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:30.295272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:30.302001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:30.302517 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:30.302953 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:30.303644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:30.304120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:30.304540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:30.437155 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:30.445422 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:30.446985 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:30.450645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d41fcb0f-21cb-4fb4-839d-89dfdaa19f1a tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1731 microversion: 2.20 time: 0.157918 Aug 25 03:35:30.450645 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 620/1227] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:30 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:35:31.471701 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:35:31.472325 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:35:31.478989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:31.479973 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:31.480410 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:31.481105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:35:31.481555 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:35:31.481979 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:35:31.615873 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:31.624714 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:31.626228 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:35:31.627643 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0b6f742d-e23a-4eb7-93e0-31586e4b0f39 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1718 microversion: 2.20 time: 0.159935 Aug 25 03:35:31.628211 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 608/1228] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:35:31 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:36:02.363408 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:02.366385 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=47 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:02.607302 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-222303e5-8a29-4d11-9750-0fd1c7f5b148 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Action: 'create', calling method: .version_select at 0x7fa33dfcbd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1059447651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyIdHSY3JI7y9WG7k3L6nSKWe+c/eMSJxXJ3ydCze+GovpZ/jgu63FoES+u4rmgnvsYUkKYyPKJZcpt0ZBelckCRNOm/j0F/je/PpptdF1aD/E7GxI3m5QWUv+2ImhXNg=="}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:36:02.625757 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-222303e5-8a29-4d11-9750-0fd1c7f5b148 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Getting quotas for project d34a968ff59e43e796b4b48b35374bc7. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:36:02.629927 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.quota [None req-222303e5-8a29-4d11-9750-0fd1c7f5b148 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Getting quotas for user 9f32ba4c897c4003ba27ebc78c6d05a1 and project d34a968ff59e43e796b4b48b35374bc7. Resources: {'key_pairs'} {{(pid=121277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:36:02.716019 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-222303e5-8a29-4d11-9750-0fd1c7f5b148 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.358982 Aug 25 03:36:02.716642 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 621/1229] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 25 03:36:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:36:26.879010 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-263166255", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1059447651", "security_groups": [{"name": "tempest-secgroup-smoke-1486324980"}], "networks": [{"uuid": "e8363d0c-a053-45db-8b9d-3a161ead4ba2"}], "block_device_mapping_v2": [{"uuid": "e6a525b9-77f1-454d-a080-2e859417003f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:36:26.888638 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=37 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:26.890233 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=60 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:26.992757 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.network.neutron [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] validate_networks() for [('e8363d0c-a053-45db-8b9d-3a161ead4ba2', None, None, None, None, None)] {{(pid=121278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:36:27.448744 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Flavor limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:36:27.449158 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Image limits 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:36:27.449648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Flavor pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:36:27.450048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Image pref 0:0:0 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:36:27.450507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.virt.hardware [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:36:27.459738 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:27.460212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:27.460640 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:27.461355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:27.461800 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:27.462215 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:27.478436 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Getting quotas for project d34a968ff59e43e796b4b48b35374bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:36:27.482326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.quota [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Getting quotas for user 9f32ba4c897c4003ba27ebc78c6d05a1 and project d34a968ff59e43e796b4b48b35374bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=121278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:36:27.537476 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Going to run 1 instances... {{(pid=121278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:36:27.539712 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6a525b9-77f1-454d-a080-2e859417003f',volume_size=None,volume_type=None)] {{(pid=121278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:36:28.019086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9c1d182d-b4e0-44bd-9a85-5d63b024a2a9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.144271 Aug 25 03:36:28.019774 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 609/1230] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 25 03:36:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:36:28.031425 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0cc38949-37f2-44ce-9642-1f51af59b982 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:28.032233 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0cc38949-37f2-44ce-9642-1f51af59b982 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:28.036233 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=4 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:28.036894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:28.103878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0cc38949-37f2-44ce-9642-1f51af59b982 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:28.111969 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0cc38949-37f2-44ce-9642-1f51af59b982 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1088 microversion: 2.1 time: 0.084188 Aug 25 03:36:28.112528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 622/1231] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:28 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:29.133611 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:29.134222 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:29.140594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:29.141078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:29.141512 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:29.142208 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:29.142719 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:29.143231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:29.206982 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:29.214687 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1975cab9-026d-4870-b085-b76b6bf3a967 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1138 microversion: 2.1 time: 0.085517 Aug 25 03:36:29.215492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 610/1232] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:29 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:30.237904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:30.238576 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:30.245886 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:30.246399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:30.246831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:30.247733 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:30.248542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:30.249075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:30.314076 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:30.326528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-404b973e-5975-4c43-b88a-9be2f5d0f975 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1204 microversion: 2.1 time: 0.090672 Aug 25 03:36:30.326528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 623/1233] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:30 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:31.344390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:31.344998 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:31.351919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:31.352385 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:31.352818 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:31.353514 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:31.353968 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:31.354424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:31.525671 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:31.533347 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-91c08559-84c4-427e-b631-7d50bb5efdea tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1272 microversion: 2.1 time: 0.192859 Aug 25 03:36:31.533920 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 611/1234] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:31 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1272 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:31.811454 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-c5841d1f-cf9e-44a0-9669-c0c9ca50c2c2 req-dd46f92a-a629-4aa8-99c1-a9d830349ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07432bce-33c4-447c-8d14-13c76689f5bb", "tag": "e7aa970b-4867-4957-929f-88d729933e55"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:36:31.822124 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c5841d1f-cf9e-44a0-9669-c0c9ca50c2c2 req-dd46f92a-a629-4aa8-99c1-a9d830349ad4 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:31.822629 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c5841d1f-cf9e-44a0-9669-c0c9ca50c2c2 req-dd46f92a-a629-4aa8-99c1-a9d830349ad4 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:31.823052 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-c5841d1f-cf9e-44a0-9669-c0c9ca50c2c2 req-dd46f92a-a629-4aa8-99c1-a9d830349ad4 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:31.835211 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-c5841d1f-cf9e-44a0-9669-c0c9ca50c2c2 req-dd46f92a-a629-4aa8-99c1-a9d830349ad4 service nova] Creating event network-changed:e7aa970b-4867-4957-929f-88d729933e55 for instance 07432bce-33c4-447c-8d14-13c76689f5bb on hv-cinder-85164 Aug 25 03:36:31.840303 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-c5841d1f-cf9e-44a0-9669-c0c9ca50c2c2 req-dd46f92a-a629-4aa8-99c1-a9d830349ad4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033779 Aug 25 03:36:31.841065 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 624/1235] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:36:32.555312 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:32.555924 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:32.562624 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:32.563104 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:32.563537 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:32.564234 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:32.564687 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:32.565120 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:32.701892 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:32.710294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-808dd417-8155-4d44-85dc-fa29eb102945 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.158807 Aug 25 03:36:32.710870 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 612/1236] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:32 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:33.731810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:33.732509 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:33.739158 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:33.739634 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:33.740068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:33.740758 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:33.741209 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:33.741631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:33.869924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:33.877510 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-86c9106d-227c-471d-9d0c-19b852d9a5ba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.149955 Aug 25 03:36:33.878093 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 625/1237] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:33 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:34.898674 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:34.899220 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:34.905490 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:34.905955 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:34.906407 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:34.907086 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:34.907527 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:34.907946 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:35.039454 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:35.047135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9d593767-6b65-4ec9-9f82-6a20fdf6e912 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.153174 Aug 25 03:36:35.047708 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 613/1238] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:34 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:35.499225 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:35.501383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:35.508272 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:35.508747 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:35.509183 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:35.509870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:35.510344 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:35.510769 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:35.539185 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c196ffed-0bc2-4f26-8ef6-6e3b259f9cc1 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043973 Aug 25 03:36:35.539743 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 626/1239] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Aug 25 03:36:35 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:35.600300 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:35.603000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:35.606765 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:35.607244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:35.607674 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:35.608358 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:35.608805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:35.609227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:35.633878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Going to try to terminate instance {{(pid=121278) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:36:35.885495 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-a3f259a2-9443-4146-96e3-4fb37447230e tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 204 len: 0 microversion: 2.20 time: 0.288695 Aug 25 03:36:35.885988 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 614/1240] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Aug 25 03:36:35 2022] DELETE /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 03:36:35.894849 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:35.897438 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:35.901491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:35.901972 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:35.902449 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:35.903194 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:35.903654 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:35.904075 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:36.031063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:36.039787 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:36.042222 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:36.042497 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5ec7287f-db9d-46b3-9dd8-2f6ffb1b2520 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.152025 Aug 25 03:36:36.043066 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 627/1241] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:36:35 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:36:36.068626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:36.069357 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:36.075724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:36.076212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:36.076635 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:36.077320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:36.077771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:36.078193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:36.217943 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:36.225614 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bc055235-7eb5-4c41-9958-7ba3befbc9f0 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.161778 Aug 25 03:36:36.226189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 615/1242] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:36 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:37.065219 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:37.065843 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:37.072409 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:37.072875 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:37.073298 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:37.073977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:37.074447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:37.074861 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:37.203683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:37.212299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:37.213810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:37.215009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-7d580136-60a7-4aa7-95fe-f66e0777fba5 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1724 microversion: 2.20 time: 0.153702 Aug 25 03:36:37.215578 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 628/1243] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:36:37 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:36:37.245856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:37.246521 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:37.253461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:37.254141 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:37.254615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:37.255399 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:37.255855 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:37.256280 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:37.388144 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:37.396442 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6b957d7a-e52b-49d3-86c8-3383c30c72f7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.154389 Aug 25 03:36:37.397015 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 616/1244] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:37 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:38.237828 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:38.239059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:38.242080 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell0:SELECT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:38.247023 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:38.247503 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:38.247935 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:38.248636 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:38.249135 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:38.249557 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:38.323585 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:38.332106 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:38.333631 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:38.334811 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-56a5ddbc-9297-4f2d-98ab-3cfbdfb15402 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1656 microversion: 2.20 time: 0.100910 Aug 25 03:36:38.335369 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 629/1245] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:36:38 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:36:38.417255 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:38.417872 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:38.419927 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=2 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:38.420596 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell0:SELECT=6 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:36:38.427009 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:38.432691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:38.432691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:38.432691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:38.432691 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:38.433134 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:38.828191 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:38.836548 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6fa9fe54-6c2f-4541-9cb1-6de84f5cc1a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.423211 Aug 25 03:36:38.837212 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 617/1246] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:38 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:38.940043 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-08338f2d-697e-4170-9b84-2705bdfe641a req-6cb5a92c-c9ae-409d-93ef-575427cb92ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3cf80-7d6d-476e-8bdf-505e26458720", "name": "network-vif-deleted", "tag": "c4e50523-60cc-43ab-a3c5-8e6094960565"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:36:38.949500 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-08338f2d-697e-4170-9b84-2705bdfe641a req-6cb5a92c-c9ae-409d-93ef-575427cb92ba service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:38.949975 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-08338f2d-697e-4170-9b84-2705bdfe641a req-6cb5a92c-c9ae-409d-93ef-575427cb92ba service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:38.958048 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-08338f2d-697e-4170-9b84-2705bdfe641a req-6cb5a92c-c9ae-409d-93ef-575427cb92ba service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:38.962383 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-08338f2d-697e-4170-9b84-2705bdfe641a req-6cb5a92c-c9ae-409d-93ef-575427cb92ba service nova] Creating event network-vif-deleted:c4e50523-60cc-43ab-a3c5-8e6094960565 for instance e7d3cf80-7d6d-476e-8bdf-505e26458720 on hv-cinder-85164 Aug 25 03:36:38.967468 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-08338f2d-697e-4170-9b84-2705bdfe641a req-6cb5a92c-c9ae-409d-93ef-575427cb92ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Aug 25 03:36:38.968068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 630/1247] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:36:39.358193 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:39.358834 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:39.364816 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:39.365294 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:39.365727 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:39.366452 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:39.366912 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:39.367334 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:39.429400 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:39.437880 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:39.439425 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08a52103c0f4467c8366bd88e8b655e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e22a25921ea45eba0f29a87edaba447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:39.440597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d3ced543-08af-4935-bc94-82e8f469bcf9 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 200 len: 1656 microversion: 2.20 time: 0.086450 Aug 25 03:36:39.441646 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 618/1248] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:36:39 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:36:39.858540 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:39.859347 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:39.866605 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:39.867095 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:39.867531 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:39.868240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:39.868690 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:39.869141 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:40.006534 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:40.014169 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0d3db34a-2c4c-4e17-84be-e560dae7d24d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.160432 Aug 25 03:36:40.014772 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 631/1249] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:39 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:40.464338 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:40.464941 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:40.471274 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:40.471755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:40.472178 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:40.473618 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:40.474063 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:40.474518 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:40.487876 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] HTTP exception thrown: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Request method failure captured: Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 HTTP/1.1 Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuwc8L8uKM4DNNX0PwZoNsbqmFFU_RAUS3tXzCMQR_843EpoItbSWYuIJDhYpQsrDRaIYQ-jCsF4VXpmGEzaWyNRYNaupIK0HKi_dbOyVXIMi7eFoR-Rj0-vYnUcmVEHGI4hG9x28vwtkIKUrQZ_wnQsO4OpbTI6nqVdRcv0hejqW4k Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:36:40.489523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e22a25921ea45eba0f29a87edaba447"}]}] Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 08a52103c0f4467c8366bd88e8b655e9 Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:40.495908 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'e7d3cf80-7d6d-476e-8bdf-505e26458720'} Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:36:40.496815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:40.498246 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:40.499615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Returning 404 to user: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:36:40.499615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-da0e4906-f482-40b7-b553-1294fe286f36 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 404 len: 111 microversion: 2.20 time: 0.030522 Aug 25 03:36:40.499615 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 619/1250] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:36:40 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:36:40.500063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-9bf45f02-0ede-4d23-82d7-71db2f3c0c2d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '.version_select at 0x7fa33a89f5e0>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:40.595728 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-9bf45f02-0ede-4d23-82d7-71db2f3c0c2d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027313204" status: 204 len: 0 microversion: 2.20 time: 0.099440 Aug 25 03:36:40.596240 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 632/1251] 10.222.0.58 () {60 vars in 1262 bytes} [Thu Aug 25 03:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027313204 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 03:36:41.034036 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:41.034775 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:41.040725 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:41.041204 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:41.041634 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:41.042343 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:41.042799 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:41.043219 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:41.177844 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:41.185982 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-0dfa4b29-42cf-4f4b-9640-a67b9ca3d007 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.155746 Aug 25 03:36:41.186523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 620/1252] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:41 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:42.208480 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:42.209083 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:42.215131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:42.215608 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:42.216056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:42.216720 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:42.217170 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:42.217592 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:42.353393 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:42.361132 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-133d19a5-3c71-4299-9611-a185f6eb88af tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.157601 Aug 25 03:36:42.361708 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 633/1253] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:42 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:42.630685 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:42.631308 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:42.637849 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:42.638364 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:42.638805 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:42.639501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:42.639953 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:42.640379 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:42.653885 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] HTTP exception thrown: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Request method failure captured: Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: DELETE /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 HTTP/1.1 Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuwc8L8uKM4DNNX0PwZoNsbqmFFU_RAUS3tXzCMQR_843EpoItbSWYuIJDhYpQsrDRaIYQ-jCsF4VXpmGEzaWyNRYNaupIK0HKi_dbOyVXIMi7eFoR-Rj0-vYnUcmVEHGI4hG9x28vwtkIKUrQZ_wnQsO4OpbTI6nqVdRcv0hejqW4k Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:36:42.655484 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e22a25921ea45eba0f29a87edaba447"}]}] Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 08a52103c0f4467c8366bd88e8b655e9 Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.657296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'e7d3cf80-7d6d-476e-8bdf-505e26458720'} Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:36:42.658270 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.659996 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.661583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Returning 404 to user: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:36:42.661583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6bc70fdd-572e-4cb9-9772-b77421628617 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 404 len: 111 microversion: 2.20 time: 0.030887 Aug 25 03:36:42.661583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 621/1254] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Aug 25 03:36:42 2022] DELETE /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:36:42.665380 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:42.665993 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e7d3cf80-7d6d-476e-8bdf-505e26458720] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:42.672056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:42.672528 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:42.672966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:42.673660 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:42.674114 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:42.674573 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:42.688691 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] HTTP exception thrown: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Request method failure captured: Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 HTTP/1.1 Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuwc8L8uKM4DNNX0PwZoNsbqmFFU_RAUS3tXzCMQR_843EpoItbSWYuIJDhYpQsrDRaIYQ-jCsF4VXpmGEzaWyNRYNaupIK0HKi_dbOyVXIMi7eFoR-Rj0-vYnUcmVEHGI4hG9x28vwtkIKUrQZ_wnQsO4OpbTI6nqVdRcv0hejqW4k Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:36:42.690349 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e22a25921ea45eba0f29a87edaba447"}]}] Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 08a52103c0f4467c8366bd88e8b655e9 Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.692802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'e7d3cf80-7d6d-476e-8bdf-505e26458720'} Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:36:42.693818 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. Aug 25 03:36:42.696131 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:42.697627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Returning 404 to user: Instance e7d3cf80-7d6d-476e-8bdf-505e26458720 could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:36:42.697627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-49776583-38b9-4041-b28b-16034bca606d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720" status: 404 len: 111 microversion: 2.20 time: 0.031104 Aug 25 03:36:42.697627 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 634/1255] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:36:42 2022] GET /compute/v2.1/servers/e7d3cf80-7d6d-476e-8bdf-505e26458720 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:36:43.381781 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:43.382408 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:43.388291 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:43.388762 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:43.389190 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:43.389866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:43.390330 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:43.390755 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:43.535000 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:43.543471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b1c267a7-9dfe-4f54-b796-e8da2620e869 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.165719 Aug 25 03:36:43.544061 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 622/1256] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:43 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:43.886012 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-6eff2ba5-a140-41ae-8b7e-2ec1b59cd105 req-c95c7a6e-4275-4185-9237-98a132dad31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07432bce-33c4-447c-8d14-13c76689f5bb", "name": "network-vif-plugged", "status": "completed", "tag": "e7aa970b-4867-4957-929f-88d729933e55"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:36:43.896312 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-6eff2ba5-a140-41ae-8b7e-2ec1b59cd105 req-c95c7a6e-4275-4185-9237-98a132dad31c service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:43.896780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-6eff2ba5-a140-41ae-8b7e-2ec1b59cd105 req-c95c7a6e-4275-4185-9237-98a132dad31c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:43.897202 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-6eff2ba5-a140-41ae-8b7e-2ec1b59cd105 req-c95c7a6e-4275-4185-9237-98a132dad31c service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:43.908237 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-6eff2ba5-a140-41ae-8b7e-2ec1b59cd105 req-c95c7a6e-4275-4185-9237-98a132dad31c service nova] Creating event network-vif-plugged:e7aa970b-4867-4957-929f-88d729933e55 for instance 07432bce-33c4-447c-8d14-13c76689f5bb on hv-cinder-85164 Aug 25 03:36:43.913052 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-6eff2ba5-a140-41ae-8b7e-2ec1b59cd105 req-c95c7a6e-4275-4185-9237-98a132dad31c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030717 Aug 25 03:36:43.913622 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 635/1257] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:36:43.971669 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:43.972309 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:43.978692 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:43.979177 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:43.979645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:43.980420 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:43.980875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:43.981303 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:43.995697 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.wsgi [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] HTTP exception thrown: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Request method failure captured: Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: request: DELETE /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed HTTP/1.1 Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept: application/json Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Accept-Encoding: identity Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Connection: close Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Length: 0 Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Content-Type: application/json Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Host: 10.222.0.58 Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Openstack-System-Scope: None Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: User-Agent: python-urllib3/1.26.11 Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Auth-Token: gAAAAABjBuwc8L8uKM4DNNX0PwZoNsbqmFFU_RAUS3tXzCMQR_843EpoItbSWYuIJDhYpQsrDRaIYQ-jCsF4VXpmGEzaWyNRYNaupIK0HKi_dbOyVXIMi7eFoR-Rj0-vYnUcmVEHGI4hG9x28vwtkIKUrQZ_wnQsO4OpbTI6nqVdRcv0hejqW4k Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Id: None Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Domain-Name: None Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Identity-Status: Confirmed Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Is-Admin-Project: True Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Id: default Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Domain-Name: Default Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Role: reader,member Aug 25 03:36:43.997279 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Roles: reader,member Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e22a25921ea45eba0f29a87edaba447"}]}] Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Id: default Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Domain-Name: Default Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Id: 08a52103c0f4467c8366bd88e8b655e9 Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: method: > Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: exception: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:43.999149 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: action_args: {'id': 'e13340cf-6d9d-48f1-9b26-78bd805f1aed'} Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:36:43.999992 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:44.001331 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.002801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Returning 404 to user: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. {{(pid=121278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:36:44.002801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ddc9fcd3-66de-42d1-85e8-5f528d7d552d tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 404 len: 111 microversion: 2.20 time: 0.030988 Aug 25 03:36:44.002801 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 623/1258] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Aug 25 03:36:43 2022] DELETE /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:36:44.008806 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:44.009715 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] [instance: e13340cf-6d9d-48f1-9b26-78bd805f1aed] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:44.016063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:44.016537 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:44.016966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:44.017651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:44.018096 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:44.018544 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:44.033320 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] HTTP exception thrown: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Request method failure captured: Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed HTTP/1.1 Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBuwc8L8uKM4DNNX0PwZoNsbqmFFU_RAUS3tXzCMQR_843EpoItbSWYuIJDhYpQsrDRaIYQ-jCsF4VXpmGEzaWyNRYNaupIK0HKi_dbOyVXIMi7eFoR-Rj0-vYnUcmVEHGI4hG9x28vwtkIKUrQZ_wnQsO4OpbTI6nqVdRcv0hejqW4k Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:36:44.035034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e22a25921ea45eba0f29a87edaba447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e22a25921ea45eba0f29a87edaba447"}]}] Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: 3e22a25921ea45eba0f29a87edaba447 Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-425850293 Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 08a52103c0f4467c8366bd88e8b655e9 Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-425850293-project Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:44.036637 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': 'e13340cf-6d9d-48f1-9b26-78bd805f1aed'} Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:36:44.038479 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. Aug 25 03:36:44.039846 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:36:44.041044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] Returning 404 to user: Instance e13340cf-6d9d-48f1-9b26-78bd805f1aed could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:36:44.041044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e2fafb6a-24d7-445a-85c2-f851cbb6e639 tempest-AttachVolumeShelveTestJSON-425850293 tempest-AttachVolumeShelveTestJSON-425850293-project] 10.222.0.58 "GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed" status: 404 len: 111 microversion: 2.20 time: 0.032891 Aug 25 03:36:44.041044 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 636/1259] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Aug 25 03:36:44 2022] GET /compute/v2.1/servers/e13340cf-6d9d-48f1-9b26-78bd805f1aed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:36:44.564106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:44.564724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:44.570922 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:44.571409 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:44.571838 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:44.572536 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:44.572986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:44.573416 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:44.773775 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:44.783653 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-acef3248-d55e-43f1-8cf6-e6257d25c67b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.223455 Aug 25 03:36:44.784244 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 624/1260] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:44 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:45.805255 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:45.806800 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:45.814018 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:45.815960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:45.815960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:45.815960 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:45.819266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:45.819266 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:45.963644 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:45.971609 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d2148bf3-5142-470f-8244-4e994574a6d3 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1260 microversion: 2.1 time: 0.170534 Aug 25 03:36:45.972196 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 637/1261] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:45 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:46.992958 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:46.993622 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:47.003517 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:47.008539 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:47.008983 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:47.011189 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:47.012626 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:47.013779 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:47.242573 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:47.253880 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-5646d29c-b2de-4e7a-ba10-f84eb1b25ae9 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1444 microversion: 2.1 time: 0.265111 Aug 25 03:36:47.255481 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 625/1262] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:46 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1444 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:47.277001 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:36:47.278907 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:36:47.290033 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:47.290667 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:47.291172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:47.292129 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:47.292791 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:47.293423 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:47.486014 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:36:47.505009 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d85dd0f8-cb19-403f-87ef-7a05bfba4487 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1444 microversion: 2.1 time: 0.232047 Aug 25 03:36:47.505883 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 638/1263] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:36:47 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1444 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:36:49.972986 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-98a08a2a-3d65-45d4-a94d-7617ecd9dc7e req-dddd41bf-26d2-491b-9e45-5df3405ab338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07432bce-33c4-447c-8d14-13c76689f5bb", "tag": "e7aa970b-4867-4957-929f-88d729933e55"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:36:49.987866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-98a08a2a-3d65-45d4-a94d-7617ecd9dc7e req-dddd41bf-26d2-491b-9e45-5df3405ab338 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:36:49.988341 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-98a08a2a-3d65-45d4-a94d-7617ecd9dc7e req-dddd41bf-26d2-491b-9e45-5df3405ab338 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:36:49.989553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-98a08a2a-3d65-45d4-a94d-7617ecd9dc7e req-dddd41bf-26d2-491b-9e45-5df3405ab338 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:36:50.003071 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-98a08a2a-3d65-45d4-a94d-7617ecd9dc7e req-dddd41bf-26d2-491b-9e45-5df3405ab338 service nova] Creating event network-changed:e7aa970b-4867-4957-929f-88d729933e55 for instance 07432bce-33c4-447c-8d14-13c76689f5bb on hv-cinder-85164 Aug 25 03:36:50.009314 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-98a08a2a-3d65-45d4-a94d-7617ecd9dc7e req-dddd41bf-26d2-491b-9e45-5df3405ab338 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183483 Aug 25 03:36:50.010392 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 626/1264] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:39:03.805796 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec70034d-e3f0-4538-a29d-1ba7413131c8] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 03:39:03.807138 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:39:03.807280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Thu Aug 25 03:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb/action (ip 10.222.0.58) !!! Aug 25 03:39:03.808611 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 03:39:03.808756 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Thu Aug 25 03:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb/action (ip 10.222.0.58) !!! Aug 25 03:39:03.809999 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:39:03.810750 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=70 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:39:03.814740 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:39:03.815262 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:03.825516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:03.825991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:03.826453 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:03.827137 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:03.827580 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:03.828008 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:03.851867 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.objects.instance [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lazy-loading 'flavor' on Instance uuid 07432bce-33c4-447c-8d14-13c76689f5bb {{(pid=121277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:39:04.128365 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-28cb178d-8beb-47ad-8290-3ce3f502ca45 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "POST /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.324306 Aug 25 03:39:04.128959 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 639/1265] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:39:03 2022] POST /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:39:04.135788 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fd3bad5-6f61-4f18-9f4e-6a45a47ae731] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 03:39:04.136726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 25 03:39:04.138361 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:39:04.139122 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:39:04.144362 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:04.145030 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:04.151388 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:04.151856 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:04.152310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:04.152987 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:04.153431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:04.153845 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:04.292989 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:04.300483 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-9b1ae4f7-e867-4de5-9576-d0a8d44af61a tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.166677 Aug 25 03:39:04.301107 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 627/1266] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:04 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:05.324108 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:05.324845 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:05.331970 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:05.332448 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:05.333789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:05.333789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:05.334034 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:05.334429 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:05.337853 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec70034d-e3f0-4538-a29d-1ba7413131c8] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 54794. Aug 25 03:39:05.647775 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:05.655554 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-88ca5da9-2dba-4fb8-86dd-bfb95cba45a4 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.336722 Aug 25 03:39:05.656120 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 640/1267] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:05 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:06.677766 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:06.678471 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:06.687404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:06.695048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:06.695048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:06.695048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:06.695048 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:06.695461 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:06.695561 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fd3bad5-6f61-4f18-9f4e-6a45a47ae731] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 54800. Aug 25 03:39:06.825493 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:06.833355 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-42e87cbf-05b2-42fe-acb9-8cd70848fa5b tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.160302 Aug 25 03:39:06.835320 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 628/1268] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:06 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:07.855169 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:07.855780 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:07.862265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:07.862762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:07.863186 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:07.863864 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:07.864307 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:07.864784 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:07.992920 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:08.000599 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-df9c2444-1707-42ea-899c-8a279865a012 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.149482 Aug 25 03:39:08.001172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 641/1269] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:07 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:09.022519 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:09.023083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:09.029433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:09.029914 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:09.030373 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:09.031070 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:09.031523 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:09.031949 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:09.166933 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:09.174641 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-690726e0-012b-47b3-9bbf-0e9cf00fa468 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.156455 Aug 25 03:39:09.175209 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 629/1270] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:09 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:10.195916 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:10.196559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:10.203032 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:10.203506 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:10.203938 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:10.204621 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:10.205079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:10.205482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:10.333017 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:10.340726 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-0e8647ca-5550-4011-a6c9-e1ee66baeb23 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.148724 Aug 25 03:39:10.341287 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 642/1271] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:10 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:11.362386 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:11.363022 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:11.369835 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:11.370326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:11.370757 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:11.371433 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:11.371875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:11.372287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:11.512704 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:11.520323 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-b0b41a2b-a4e2-461d-a5e2-a17f61713693 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.161864 Aug 25 03:39:11.520893 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 630/1272] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:11 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:12.540882 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:12.541496 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:12.547958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:12.548437 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:12.548873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:12.549556 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:12.550006 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:12.550453 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:12.682904 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:12.690606 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-d75377c7-a173-4d92-80b6-dedf5b9642fb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.153536 Aug 25 03:39:12.691172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 643/1273] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:12 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:13.712541 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:13.713170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:13.719504 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:13.719973 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:13.720395 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:13.721074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:13.721515 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:13.721930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:13.850569 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:13.858170 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bd49ebee-9959-408e-b603-84a7ceb6318c tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.150092 Aug 25 03:39:13.858773 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 631/1274] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:13 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:14.880090 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:14.880815 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:14.887991 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:14.888404 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:14.888840 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:14.889533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:14.889984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:14.890435 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:15.113516 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:15.121305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-af571e49-bff0-464e-a88a-44bb94d0e523 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.245308 Aug 25 03:39:15.121878 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 644/1275] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:14 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:16.143356 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:16.143974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:16.151592 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:16.152072 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:16.152507 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:16.153196 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:16.153648 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:16.154074 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:16.281825 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:16.289652 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-6bab9002-85dd-49c3-8754-f8880ae231e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.150234 Aug 25 03:39:16.290227 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 632/1276] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:16 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:39:17.311175 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:17.311735 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:17.318054 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:17.318562 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:17.318998 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:17.319688 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:17.320138 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:17.320559 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:17.457219 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:17.465802 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-62906d27-9946-47bd-bffb-4195d4e8ecc8 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.158456 Aug 25 03:39:17.466399 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 645/1277] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:17 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:18.487199 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:18.487808 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:18.494219 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:18.494727 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:18.495159 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:18.495896 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:18.496298 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:18.496720 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:18.677921 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:18.685968 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-d994bad9-2bb9-4084-842e-958eb067a9be tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1510 microversion: 2.1 time: 0.202728 Aug 25 03:39:18.690789 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 633/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:18 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:18.706851 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:39:18.707447 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:18.714359 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:18.714841 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:18.715275 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:18.715966 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:18.716451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:18.716870 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:18.801192 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121277) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 03:39:19.007664 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5c18d5cc-d44e-4498-b4e3-0e8dd32576e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "POST /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.304586 Aug 25 03:39:19.008340 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 646/1279] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 25 03:39:18 2022] POST /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:39:19.016311 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:19.016919 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:19.023348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:19.023825 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:19.024256 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:19.024945 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:19.025390 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:19.025807 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:19.159990 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:19.168597 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-ca5a7125-8be3-4b3f-b0f2-c82ffb71155f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1518 microversion: 2.1 time: 0.155959 Aug 25 03:39:19.169492 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 634/1280] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:19 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:20.190653 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:20.191305 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:20.197274 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:20.197752 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:20.198205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:20.198899 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:20.199350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:20.199774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:20.326827 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:20.335061 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-5fdbe0ed-41d7-4c4e-bca2-70c97ed42df2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1520 microversion: 2.1 time: 0.148772 Aug 25 03:39:20.335625 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 647/1281] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:20 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:20.647678 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-fed7fc6d-75d5-4eee-a6dd-897e077ad19a req-d66750a5-a278-49f7-87e6-8951bff6b064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07432bce-33c4-447c-8d14-13c76689f5bb", "name": "network-vif-unplugged", "status": "completed", "tag": "e7aa970b-4867-4957-929f-88d729933e55"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:39:20.657584 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-fed7fc6d-75d5-4eee-a6dd-897e077ad19a req-d66750a5-a278-49f7-87e6-8951bff6b064 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:20.658090 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-fed7fc6d-75d5-4eee-a6dd-897e077ad19a req-d66750a5-a278-49f7-87e6-8951bff6b064 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:20.658543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-fed7fc6d-75d5-4eee-a6dd-897e077ad19a req-d66750a5-a278-49f7-87e6-8951bff6b064 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:20.669431 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.compute.server_external_events [req-fed7fc6d-75d5-4eee-a6dd-897e077ad19a req-d66750a5-a278-49f7-87e6-8951bff6b064 service nova] Unable to find a host for instance 07432bce-33c4-447c-8d14-13c76689f5bb. Dropping event network-vif-unplugged {{(pid=121278) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 03:39:20.670326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-fed7fc6d-75d5-4eee-a6dd-897e077ad19a req-d66750a5-a278-49f7-87e6-8951bff6b064 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027189 Aug 25 03:39:20.670898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 635/1282] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 03:39:21.356189 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:21.356765 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:21.363079 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:21.363555 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:21.363986 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:21.364665 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:21.365716 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:21.366136 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:21.493361 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:21.501107 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-bd6e2d28-5a7f-4a31-9337-ef55735bb0c7 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.148956 Aug 25 03:39:21.501677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 648/1283] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:21 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:22.522038 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:22.522681 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:22.529053 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:22.529531 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:22.529964 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:22.530684 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:22.531137 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:22.531558 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:22.659878 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:22.668012 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bfb23d85-c926-47ce-9110-4fca60167eb5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.149914 Aug 25 03:39:22.668790 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 636/1284] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:22 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:23.689056 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:23.689734 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:23.696683 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:23.697171 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:23.697604 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:23.698309 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:23.698762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:23.699187 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:23.832762 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:23.840482 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-c5bdb13f-5eb7-4e4b-a790-5fa34906f175 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.155295 Aug 25 03:39:23.841060 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 649/1285] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:23 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:24.861530 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:24.862083 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:24.868449 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:24.868930 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:24.869369 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:24.870054 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:24.870534 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:24.870959 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:24.998135 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:25.006296 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-4d2e9167-f42a-4ecf-8e8d-4f6bd7e330e2 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.148259 Aug 25 03:39:25.006883 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 637/1286] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:24 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:26.026831 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:26.027443 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:26.034421 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:26.034898 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:26.035348 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:26.036090 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:26.036538 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:26.037671 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:26.167859 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:26.175569 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e8518c31-8012-42b2-afd6-9e051db91f6f tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.152575 Aug 25 03:39:26.176140 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 650/1287] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:26 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:27.196617 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:27.197220 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:27.204245 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:27.204722 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:27.205153 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:27.205840 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:27.206319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:27.206745 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:27.334437 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:27.342108 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-acb22131-eb65-441e-9e51-ba16d4666fcb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.149351 Aug 25 03:39:27.342739 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 638/1288] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:27 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:28.363205 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:28.364111 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:28.371098 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:28.371575 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:28.372005 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:28.372696 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:28.373147 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:28.373571 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:28.502984 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:28.511491 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-84ad8098-1e5f-49f0-9012-f26c52a29aba tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.152301 Aug 25 03:39:28.512063 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 651/1289] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:28 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:29.532677 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:29.533326 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:29.539898 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:29.540376 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:29.540811 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:29.541500 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:29.541947 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:29.542399 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:29.675771 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:29.684235 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-03390cb9-4726-4924-9dcc-8cec449a3efb tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.155470 Aug 25 03:39:29.684880 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 639/1290] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:29 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:30.705059 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:30.705719 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:30.713042 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:30.713523 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:30.713958 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:30.714670 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:30.715119 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:30.715542 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:30.734068 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:39:30.851789 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:30.859533 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-754f8385-a855-4060-8e53-afb8820949ad tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.158335 Aug 25 03:39:30.860149 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 652/1291] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:30 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:31.880583 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:31.881201 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:31.887711 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:31.888124 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:31.888553 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:31.889239 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:31.889686 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:31.890105 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:32.023330 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:32.030875 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-bb4f7aff-da19-4f65-943d-f959e29a650d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.154240 Aug 25 03:39:32.031446 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 640/1292] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:31 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:32.760420 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-bbd978d5-4ade-4740-a77a-5087aabcef2c req-1bc24838-ed6f-4e10-82e0-f8b56b648afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07432bce-33c4-447c-8d14-13c76689f5bb", "name": "network-vif-plugged", "status": "completed", "tag": "e7aa970b-4867-4957-929f-88d729933e55"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:39:32.770153 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bbd978d5-4ade-4740-a77a-5087aabcef2c req-1bc24838-ed6f-4e10-82e0-f8b56b648afe service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:32.770651 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bbd978d5-4ade-4740-a77a-5087aabcef2c req-1bc24838-ed6f-4e10-82e0-f8b56b648afe service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:32.771230 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-bbd978d5-4ade-4740-a77a-5087aabcef2c req-1bc24838-ed6f-4e10-82e0-f8b56b648afe service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:32.782350 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-bbd978d5-4ade-4740-a77a-5087aabcef2c req-1bc24838-ed6f-4e10-82e0-f8b56b648afe service nova] Creating event network-vif-plugged:e7aa970b-4867-4957-929f-88d729933e55 for instance 07432bce-33c4-447c-8d14-13c76689f5bb on hv-cinder-85164 Aug 25 03:39:32.787299 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-bbd978d5-4ade-4740-a77a-5087aabcef2c req-1bc24838-ed6f-4e10-82e0-f8b56b648afe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030617 Aug 25 03:39:32.787876 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 653/1293] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:39:33.051860 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:33.052997 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:33.060102 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:33.060594 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:33.061033 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:33.061798 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:33.062258 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:33.062703 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:33.222674 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:33.231743 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-03eeb763-79a5-4da0-b16b-f60f15c6c263 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.183794 Aug 25 03:39:33.232319 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 641/1294] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:33 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:34.254155 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:34.254894 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:34.257456 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:39:34.262405 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:34.262889 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:34.263328 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:34.264041 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:34.264494 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:34.264918 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:34.397265 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:34.404977 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-02123977-1c81-4261-8f91-5df199b93079 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1576 microversion: 2.1 time: 0.155498 Aug 25 03:39:34.405551 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 654/1295] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:34 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:39:35.426310 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:39:35.426931 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:39:35.433669 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:35.434138 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:35.434591 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:35.435278 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:39:35.435726 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:39:35.436147 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:39:35.565375 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:39:35.573645 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8bb097f6-65ac-4831-b5aa-026291f48a03 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1563 microversion: 2.1 time: 0.151313 Aug 25 03:39:35.574218 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 642/1296] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:39:35 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:41:11.693825 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_api:SELECT=1 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:41:11.694584 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG dbcounter [-] [121277] Writing DB stats nova_cell1:SELECT=10 {{(pid=121277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:41:11.695443 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:41:11.695853 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Thu Aug 25 03:41:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 25 03:41:11.697078 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:41:11.697253 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: Thu Aug 25 03:41:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 25 03:41:11.698195 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_api:SELECT=32 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:41:11.706478 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG dbcounter [-] [121278] Writing DB stats nova_cell1:SELECT=92 {{(pid=121278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:41:11.706623 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:41:11.706623 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:41:11.706833 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [req-ff41dafe-f0b4-4d10-a356-5aa59ad794ae req-d06dbf5f-4934-4238-906a-80ac69f20e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07432bce-33c4-447c-8d14-13c76689f5bb", "tag": "e7aa970b-4867-4957-929f-88d729933e55"}]} {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:41:11.716268 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:11.716559 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-ff41dafe-f0b4-4d10-a356-5aa59ad794ae req-d06dbf5f-4934-4238-906a-80ac69f20e39 service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:11.716758 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:11.717037 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-ff41dafe-f0b4-4d10-a356-5aa59ad794ae req-d06dbf5f-4934-4238-906a-80ac69f20e39 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:11.717173 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:11.717545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [req-ff41dafe-f0b4-4d10-a356-5aa59ad794ae req-d06dbf5f-4934-4238-906a-80ac69f20e39 service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:11.717874 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:11.718355 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:11.718782 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:11.729866 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.compute.server_external_events [req-ff41dafe-f0b4-4d10-a356-5aa59ad794ae req-d06dbf5f-4934-4238-906a-80ac69f20e39 service nova] Creating event network-changed:e7aa970b-4867-4957-929f-88d729933e55 for instance 07432bce-33c4-447c-8d14-13c76689f5bb on hv-cinder-85164 Aug 25 03:41:11.737217 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [req-ff41dafe-f0b4-4d10-a356-5aa59ad794ae req-d06dbf5f-4934-4238-906a-80ac69f20e39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043949 Aug 25 03:41:11.738348 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 643/1297] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:41:11.748677 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Going to try to terminate instance {{(pid=121277) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:41:12.117940 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-90beb1d9-4268-4593-8eb2-a676abb3ff57 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "DELETE /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 204 len: 0 microversion: 2.1 time: 0.426540 Aug 25 03:41:12.121793 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 655/1298] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 25 03:41:11 2022] DELETE /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:41:12.128404 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:41:12.129544 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:41:12.135742 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:12.136480 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:12.137631 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:12.138601 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:12.139231 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:12.139660 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:12.273824 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:41:12.283087 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-1f625e9b-2e1d-4200-9911-1f01cfa9cd28 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.159191 Aug 25 03:41:12.290794 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 644/1299] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:41:12 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:41:13.304096 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:41:13.304790 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:41:13.311774 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:13.319381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:13.319381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:13.319381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:13.319381 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:13.319873 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:13.447193 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.policy [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121277) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:41:13.455424 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-e4a04562-0a85-40f4-9009-ec97f68e41e5 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1569 microversion: 2.1 time: 0.155696 Aug 25 03:41:13.456000 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 656/1300] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:41:13 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:41:14.477287 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:41:14.477984 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:41:14.485162 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:14.485774 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:14.486223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:14.486952 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:14.487424 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:14.487831 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:14.721877 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:41:14.729796 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-362246d6-f5b4-4f4c-b330-fbd86c63197d tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1450 microversion: 2.1 time: 0.256355 Aug 25 03:41:14.730223 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 645/1301] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:41:14 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1450 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:41:15.085525 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [req-342487ec-aebb-4bdc-819e-c6275b59c8f4 req-912f0248-e406-457c-970d-1c222d4dc75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07432bce-33c4-447c-8d14-13c76689f5bb", "name": "network-vif-deleted", "tag": "e7aa970b-4867-4957-929f-88d729933e55"}]} {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:41:15.095459 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-342487ec-aebb-4bdc-819e-c6275b59c8f4 req-912f0248-e406-457c-970d-1c222d4dc75a service nova] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:15.095973 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-342487ec-aebb-4bdc-819e-c6275b59c8f4 req-912f0248-e406-457c-970d-1c222d4dc75a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:15.096553 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [req-342487ec-aebb-4bdc-819e-c6275b59c8f4 req-912f0248-e406-457c-970d-1c222d4dc75a service nova] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:15.108451 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.compute.server_external_events [req-342487ec-aebb-4bdc-819e-c6275b59c8f4 req-912f0248-e406-457c-970d-1c222d4dc75a service nova] Creating event network-vif-deleted:e7aa970b-4867-4957-929f-88d729933e55 for instance 07432bce-33c4-447c-8d14-13c76689f5bb on hv-cinder-85164 Aug 25 03:41:15.113358 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [req-342487ec-aebb-4bdc-819e-c6275b59c8f4 req-912f0248-e406-457c-970d-1c222d4dc75a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090794 Aug 25 03:41:15.113955 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 657/1302] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 25 03:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:41:15.752501 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:41:15.753116 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.compute.api [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121278) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:41:15.759543 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:15.760106 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:15.760545 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:15.761238 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:15.761690 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:15.762111 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG oslo_concurrency.lockutils [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:15.828608 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.policy [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f32ba4c897c4003ba27ebc78c6d05a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a968ff59e43e796b4b48b35374bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121278) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:41:15.839127 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-53d638b7-4456-43ef-9947-7d5e47eba903 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 200 len: 1219 microversion: 2.1 time: 0.090475 Aug 25 03:41:15.839724 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 646/1303] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:41:15 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:41:16.861430 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '>' {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:41:16.862053 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.compute.api [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] [instance: 07432bce-33c4-447c-8d14-13c76689f5bb] Fetching instance by UUID {{(pid=121277) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:41:16.868276 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:16.873286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:16.873286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:16.873286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Acquiring lock "85016da6-52ca-4c0c-8aae-ef165990d859" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:41:16.873286 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:41:16.874172 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG oslo_concurrency.lockutils [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Lock "85016da6-52ca-4c0c-8aae-ef165990d859" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:41:16.884333 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.wsgi [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] HTTP exception thrown: Instance 07432bce-33c4-447c-8d14-13c76689f5bb could not be found. Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Request method failure captured: Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: request: GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb HTTP/1.1 Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept: application/json Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Accept-Encoding: identity Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Connection: close Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Length: 0 Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Content-Type: application/json Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Host: 10.222.0.58 Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: Openstack-System-Scope: None Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: User-Agent: python-urllib3/1.26.11 Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Auth-Token: gAAAAABjBu4c45YrHJiB0yVn1-8GXAkYDlqm-lsSDp30g8a5DTRGpq4c3jZqPmi7JI4-jP3xFUe2y5KtT9MoSHnUzKeBF_oyIjGS-aoT42tIg85fKU786cOLPTDB3S8hnu2Z-wbvBAoxpkyA1oYBh_t6Mih5OR6E8DZF-zLDiNBYiMXpqvj_Ivc Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Id: None Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Domain-Name: None Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Identity-Status: Confirmed Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Is-Admin-Project: True Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Id: default Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Domain-Name: Default Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Id: d34a968ff59e43e796b4b48b35374bc7 Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Project-Name: tempest-TestShelveInstance-488723685 Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Role: reader,member Aug 25 03:41:16.886011 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Roles: reader,member Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d34a968ff59e43e796b4b48b35374bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d34a968ff59e43e796b4b48b35374bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d34a968ff59e43e796b4b48b35374bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d34a968ff59e43e796b4b48b35374bc7"}]}] Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant: tempest-TestShelveInstance-488723685 Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Id: d34a968ff59e43e796b4b48b35374bc7 Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-Tenant-Name: tempest-TestShelveInstance-488723685 Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User: tempest-TestShelveInstance-488723685-project Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Id: default Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Domain-Name: Default Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Id: 9f32ba4c897c4003ba27ebc78c6d05a1 Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: X-User-Name: tempest-TestShelveInstance-488723685-project Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: method: > Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: exception: Instance 07432bce-33c4-447c-8d14-13c76689f5bb could not be found. Aug 25 03:41:16.887979 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: action_args: {'id': '07432bce-33c4-447c-8d14-13c76689f5bb'} Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: {{(pid=121277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07432bce-33c4-447c-8d14-13c76689f5bb could not be found. Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:41:16.888924 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07432bce-33c4-447c-8d14-13c76689f5bb could not be found. Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07432bce-33c4-447c-8d14-13c76689f5bb could not be found. Aug 25 03:41:16.891280 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: ERROR nova.api.openstack.wsgi Aug 25 03:41:16.892810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: DEBUG nova.api.openstack.wsgi [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Returning 404 to user: Instance 07432bce-33c4-447c-8d14-13c76689f5bb could not be found. {{(pid=121277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:41:16.892810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: INFO nova.api.openstack.requestlog [None req-3674298d-4f15-440b-83d9-dcaa0cf27ecf tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb" status: 404 len: 111 microversion: 2.1 time: 0.030909 Aug 25 03:41:16.892810 dv-cinder-851640-5-iscsi devstack@n-api.service[121277]: [pid: 121277|app: 0|req: 658/1304] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 25 03:41:16 2022] GET /compute/v2.1/servers/07432bce-33c4-447c-8d14-13c76689f5bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:41:17.128815 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: DEBUG nova.api.openstack.wsgi [None req-8a0fab23-c1df-4d9f-89a2-9a823f03f4d1 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] Calling method '.version_select at 0x7fa33a542310>' {{(pid=121278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:41:17.181974 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: INFO nova.api.openstack.requestlog [None req-8a0fab23-c1df-4d9f-89a2-9a823f03f4d1 tempest-TestShelveInstance-488723685 tempest-TestShelveInstance-488723685-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1059447651" status: 202 len: 0 microversion: 2.1 time: 0.056967 Aug 25 03:41:17.182603 dv-cinder-851640-5-iscsi devstack@n-api.service[121278]: [pid: 121278|app: 0|req: 647/1305] 10.222.0.58 () {58 vars in 1254 bytes} [Thu Aug 25 03:41:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1059447651 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)